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Number of silos in which your customer data resides. 
Coincidentally, also the number of totally different 
definitions you have for “customer.” 


definition — 
Embarcadero solutions help manage data 
enterprise-wide, enabling you to build and 
communicate an architecture of your data assets 
so you always know what is what, and where it is. 
With just one, everything gets simpler. You and 
your business are empowered to use and reuse 
reliable, relevant, and timely data across a range of 
platforms and storage formats. Understanding your 
data is finally possible, and getting a hold of the 
metadata is the key. Standards can be defined and 
enforced. Data redundancy is eliminated. It's no 
coincidence that the most sophisticated solution is 


also the simplest. See how one gets it done. 
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Solve Business Problems with Style 


L Server 


16 —Anne Grubb 


Blending ingenuity and skill, the 2007 SOL Server Magazine Innovators 

award-winning solutions include a T-SQL program that does math for a 

video poker game, a way to centrally maintain applications’ data, a data- 
base maintenance tool, and a hospital’s high-availability solution. 
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Data Warehousing: 
Slowly Changing 
Dimensions 

—Michelle A. Poolet 

When dealing with slowly changing dimen- 
sions, you can respond in three different ways. 
Find out which responses to use for different 
circumstances. 


SQL Server Read- 
Consistency Problems, 
Part 2 


—lItzik Ben-Gan 

Allocation-order scans are much faster than 
an index-order scan, but how do you keep the 
allocation-order scan from reading multiple 
rows or missing records with multiple open 
connections? Learn how to use TABLOCK and 
READ ONLY to avoid inconsistent data and 
still achieve good performance. 
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Examining XML Plans 

in Cache 

—Kalen Delaney 

A large plan cache can seriously impact 
performance. A benefit of using the plan cache 
metadata in SQL Server 2005 is the ability to 
analyze any user query without actually running 
the query. You can also compare many plans at 
the same time and avoid expensive queries. 


Moving Tables Between 
Filegroups: A Better Way 


—Onmri Bahat 

Move tables and indexed views between 
filegroups in SQL Server 2005 and SQL Server 
2000 efficiently and automatically through this 
handy script. 


A SQL Server 2005 DMV 
Cleans Up Your Indexes 
—Andrew J. Kelly 

Cleaning up unused indexes was once an almost 
impossible task. This new DMV eases the bur- 
den dramatically. Here’s how to put it to work 
in your environment. 


Tobie Dunn 


redgate’ 


www.red-gate.com/backup ingeniously simple tools for SQL Server 


ontents 


COLUMNS 
19 Eye on BI: 


My PerformancePoint Server 


Wish List 
—Douglas McDowell 


Microsoft Office PerformancePoint Server 


2007 can enhance your BI and BPM 


capabilities. But the product could be even 


better—here’s a wish list for new features 


and for how to integrate the various 
components of PPS in future releases. 
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SQL Server as a Data 
Platform ...Finally 


[ my August 2007 editorial “Too Soon for 
n SQL Server 2008?" (InstantDoc ID 96028), I 
claimed that many businesses running SQL Server as 
their database platform wouldn't be ready to migrate 
to SQL Server 2008. I still think that Microsoft's SOL 
Server release schedule isn't giving its customers time 
to catch up, but I have to admit that I haven't found 
anything negative about the upcoming release. In fact, 
SQL Server 2008 is the destination that previous SQL 
Server versions have been working toward. 

At the 2007 Professional Association for SQL Serv- 
er (PASS) conference, I spoke with Francois Ajenstat, 
the director of product management for SQL Server at 
Microsoft, about the release of SQL Server 2008. Fran- 
cois explained that Microsoft's vision for SQL Server 
2008 is bigger than just a relational database system. In- 
stead, Microsoft sees SQL Server 2008 as an enterprise 
data platform. Although the relational database engine 
is still at the heart of SQL Server 2008, the breadth of 
services that SQL Server 2008 provides goes well be- 
yond simple relational database storage. Continuing in 
the direction set by SQL Server 7.0, SOL Server 2008 
provides an end-to-end information platform. 

SQL Server 7.0’s inclusion of OLAP Services and 
business intelligence (BI) technologies marked the 
beginning of the transformation of SQL Server from 
a standard relational database server to a data plat- 
form. SQL Server 2000 added enhanced scalability 
and data-mining capabilities And SQL Server 2005 
extended SQL Servers value with the inclusion of 
SQL Server Reporting Services (SSRS). 

SQL Server 2008 builds on this base and finally 
makes the vision of SQL Server as a data platform 
a reality. The four pillars of functionality that Mi- 


S L Server 2008 this, SQL Server 2008 

that. Blah blah blah. What if you're 
still working with SQL Server 2005—or just 
now migrating to it? All this talk about SQL 
Server 2008 could make you feel like a forgot- 
ten middle sibling. Well 
Server Jan Bradys, so I f 


Know About SQL erver 
.com/needtokn i 
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crosoft sees for SOL Server 2008 are mission-critical 
platform, dynamic development, beyond relational 
data, and pervasive business insight. As a mission- 
critical data platform, SQL Server 2008 is enhanced 
with built-in transparent database encryption as well 
as policy-based management via the new Declara- 
tive Management Framework (DMF). In the area of 
dynamic development, Microsoft has added the new 
Language-Integrated Query (LINQ) extensions to the 
‚NET Framework—tevolutionizing database applica- 
tion development. New date, file stream, and geospa- 
tial data types extend SQL Server's data storage capa- 
bilities beyond traditional relational data. And SQL 
Server 2008's SSRS scalability, report design enhance- 
ments, and Microsoft Office integration help deliver 
information to users—fulfilling Microsoft's goal of 
providing pervasive business insight. 

Being a data platform sets SQL Server 2008 apart 
from the competing database products and further 
establishes the new version as the innovative leader in a 
highlycompetitiveenterprisedatabase market. And un- 
like the competing enterprise database platforms, 
Microsoft will continue to bundle BI capabilities into its 
SQL Server releases with no additional licensing costs. 

SQL Server 2008 serves both business needs and 
infrastructure needs. Not only are custom business ap- 
plications and Web sites built to access SQL Server da- 
tabases but an ever-growing number of Microsoft and 
third-party products are built on top of SQL Server as 
well. It seems to me that the only problem with SQL 
Server 2008 would be migrating to it and not taking ad- 
vantage of its increased capabilities—that is, of course, 
if you're even ready to migrate to it. SQL 

InstantDoc ID 97676 


yas A t 2005's High Avail- 
lity Options," InstantDoc ID 96237 


ECT TOP(X): SQL Server 2005 Feature Pack,” 
oc ID 95722, 


"SQL Server 2005 Data Mining Add-ins for Office 
2007," InstantDoc ID 95451 


For more resources, see my extended blog post at 


www.windowsitpro.com/go/SavvyAssistant. 


Michael Otey 


motey @ sqlmag.com) is technical director for 
Windows IT Pro and SQL Server Magazine and 


coauthor of SQL Server 2005 Developers Guide 
(Osborne/McGraw-Hill). 
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Qu: Tip: 


Thinking about migrating 
to SQL Server 2008? Read 
Brian Moran's perspective 
on leapfrogging to the new 
release in “Skipping SQL 
Server Versions," InstantDoc 
ID 96406. 

—Christan Humphries, 

Your Savvy Assistant 
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christan.humphries @ penton.com) is 


production editor for Windows IT Pro and 
SQL Server Magazine. 
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Online vs. print content: Fi 


Fitting It All into Print 
There's a vast amount of information online at Sqlmag 
„com: 10 years’ worth of articles published in SQL Server 
Magazine, hundreds of Web-exclusive articles and blog 
posts by authors and editors, and a large collection of 
posts on the Sqlmag.com forums. We know many SQL 
Server Magazine readers appreciate the convenience of 
a print publication, though, and sometimes readers ask 
us why in certain articles, some elements, such as list- 
ings, tables, or figures, are on the Web only and not in 
the print article. 

A recent email letter from reader Rick Dorris provides 
a good example. “SQLMag has taken the practice of 
publishing Web listings to the extreme. Try reading [Itzik] 
Ben-Gans article, ‘Debunking the Myths of Temporary 
Objects, Part 2’ without using a computer.... It's not like 
the magazine is busting at the seams and there's no room 
for printing code. I'm not against having some of the code 
available via the Web, but in the case of Ben-Gan’s article, 


GET ACTIVE ONLINE AT SQLMAG.COM! 
Do female SQL Server pros face more challenges than their 
male counterparts? Join the discussions at www.sqlmag.com/article/ 


articleid/97176/sql. server blog 97176.html and www.windowsitpro 
.com/Articles/ArticlelD/97461/97461.html?Ad-1. Compare what IT 


pros are saying about women in IT now with what they said in 2005 
at www.windowsitpro.com/Article/ArticlelD/45401/45401.html. 


It wasn't possible to understand the article at all without 
access to the Web listings." 

We understand the concerns of readers like Rick who 
want to see essential listings and other elements together in 
the print article. Magazine staff face a never-ending chal- 
lenge of balancing the amount of content we can fit into 
an issue with revenue to support that content. As SOL 
Server Magazine editorial strategy director Karen Forster 
said in her response to Rick, “SQL Server Magazine is an 
independent publication supported by reader subscrip- 
tions and advertising. The number of pages in any issue 
is determined by how many ads we have in that issue. We 
usually have a ratio of between 30 to 40 percent ads and 
60 to 70 percent editorial pages per issue. Just to give you 
some context, for most independent magazines, you'll 


log 


nding the right mix 


typically see a ratio of about 60 to 70 percent ads and 30 
percent editorial. 

"These business realities mean we editors struggle 
every month to provide an optimum mixture of articles 
and listings while also providing a variety of content to 
serve DBAs, DBDs, and BI readers. As a result, we are 
often forced to put listings and other content on the Web. 
Ican only apologize for the inconvenience caused by such 
tradeoffs between the number of articles we can print 
and the amount of space we can dedicate to listings. It's a 
struggle every month to figure out how to squeeze in all 
the content, but your reminders are great motivation to 
keep looking for ways to include as much of the code as 
we can." 

As you might have noticed, we launched a redesign 
of SOL Mag in October. One of our main goals for the 
redesign was so we could include more of an article's 
essential elements—such as the many code examples and 
tables in Itzik's articles—in print. Let us know what you 
think of the redesign, and keep that feedback coming to 
SQL Server Magazine editors, so we know how we can 
make your jobs easier. 


Women Fitting in IT 
There's no question that women have a presence in IT, but 
are women still struggling with establishing themselves 
in a predominantly male career area? At the Women 
in Technology panel discussion at PASS in September 
2007, none of the panelists felt they had needed to prove 
themselves as a woman in their jobs. (See the Get Active 
Online at Sglmag.com! box for a link to Megan Bearly's 
report on the panel discussion.) And reader comments 
on Production Editor Christan Humphries' blog post on 
women in the Windows IT world (see *Can You Hear Me 
Roar Now?" InstantDoc ID 97461) show that the topic 
of “women in IT” has plenty of life, but not necessarily 
that women in IT face roadblocks to success. That discus- 
sion reminded me of another editor’s post on a similar 
topic almost three years ago, which also got plenty of 
reaction (see “Gender Differences in Math and Science?” 
InstantDoc ID 45401). Take a look at the three blog posts, 
then tell us what you think about women in IT. SQL] 
InstantDoc ID 97654 
—Anne Grubb, Web site strategic editor, 
SQL Server Magazine 
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Add new levels of decision support, stunning visualization 
and rich interactivity to your applications. Discover the 
latest designer productivity features, an improved report 
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Add Crystal Reports to your development tool kit and... 

: Enable What-If analysis with Xcelsius components, 
right on your reports (as shown). 
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database. 

: Embed Flash files for stunning visualizations and 
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Included in ApexSQL Studio: 


ApexSQL Audit Active data auditing and reporting 
ApexSQL Clean Risk free delete and dependency analysis 
ApexSQL Code Template based Code Generation 
ApexSQL Diff Database comparison and synchronization 


ApexSQL Doc Database Documentation into HTML and CHM 
ApexSQL Edit Full Featured Editor/IDE for SQL Server 
ApexSQL Enforce — Customizable, Rule-based Standards Enforcement 
ApexSQL Log Database Auditing and Recovery 

ApexSQL Report Data Driven web-based Reporting 

ApexSQL Script Database scripting, packaging and deployment 
ApexSQL SSIS Diff SSIS Package Comparison and Analysis 
ApexSQL Log API Programmable API to ApexSQL Log Auditing 


ApexSQL Diff 


ApexSQL Edit 
For more information 


or to download a free trial version —Y 
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www.apexsql.com software 
or phone 866-665-5500 


T-SQL Function Finds Almost Any Kind of Date 


hile working on projects, we all create cool code 
that we think would be useful to share with others. 
The best code in the world is borrowed code because it's 
free and typically battle-hardened. Last year, I found some 
code that creates a Calendar table. As its name suggests, 
this table includes calendar data, which you can customize. 
I created the Dates function to find almost any kind of 
date in the Calendar table. For example, you can use the 
function to do the following: 
* Find the first Tuesday of the next month. 
* Determine whether the date your query just returned is 
a working day, weekday, or company holiday. 
* Create recurring-date functionality like that in Micro- 
soft Outlook. 


The Dates function is flexible and easy to maintain 
because it uses a matrix and simple math to locate the 
requested target date. Table 1 shows the matrix. To use 
the Dates function, you select one item from each column 

in the matrix and use 


ORE on the WEB each item's bold letter 
Download the code at to form an acronym 
InstantDoc ID 97590. representing your tar- 


get date. For example, 
If you want the Dates function to return the next holiday 
next month, you would use the acronym NHNM when you 
execute the function with the statement 


SELECT f dates 'NHNM' 


Using the NHNM example, let's look at how to use the 
Dates function in more detail and how it works. But before 
we do, there are two options— "Last" and “Previous”—in 
the “This” column I need to explain. You use the “Last” 
option to indicate that you want the last occurrence of 
something, such as the last holiday. You use the “Pre- 
vious” option to indicate that you want the occurrence 
before the last occurrence. For example, if today's date is 
December 31, the *Last" holiday would be Christmas and 
the “Previous” holiday would be Thanksgiving. 

To take advantage of the Dates function, you must 
first create and customize the Calendar table. On SOL 
Server Magazine's Web site, you'll find CodeToCreate- 
CalendarTable.sql, which you can run to create this table. 
(Go to www.sqlmag.com, enter 97590 in the InstantDoc 
ID text box, then click the 97590.zip hotlink.) The script 
automatically populates the table with standard holidays, 
so you only need to add a column for company-specific 
holidays and manually add those dates. 

On SQL Server Magazine's Web site, you'll find also find 
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DatesFunction.sql, which contains the code for the Dates 
function. This function works on SQL Server 2005 and 
SQL Server 2000. The Dates function has two mandatory 
parameters: the @eDate parameter, which specifies the 
current date, and the @Parm parameter, which is the 
acronym specifying the target date (in this case, NHNM). 
The function also has two optional parameters—@Day- 
Name and @xth—that you don't need 
to set for the NHNM example, so I 
won't cover them in detail here. The @ 


DayName parameter is used to find a | Which Day This 

day of week. For example, you can use First Day This 

it to find the next Monday this month. | 

When you select the *Xth" option in E : Wons Bey lei 

the “Which” column, you use the @xth — | Next Holiday Next 
arameter. Xth is just like Nth. With the 

p : Xth Named Day Previous 


*Xth" option, you can find, for example, — |^ 
the third Wednesday next month. | This 
Playing with all the function's options 
and parameters is the best way to learn 
how to use the function and to see how flexible it is. 

The Dates function divides the acronym in the @Parm 
parameter into separate parts based on each letter's posi- 
tion by using the code 


SELECT 8A = SUBSTRING(@Parm,1,1) 
SELECT 8B = SUBSTRING(@Parm,2,1) 
SELECT 8C = SUBSTRING(@Parm,3,1) 


SELECT aD = SUBSTRING(@Parm,4,1) 


So, in our NHNM example, @A = N, @B = H, @C = 
N, and @D = M. 

To calculate the target date, the Dates function 
first uses the @C and @D variables to determine the 
number of days in the specified period (e.g., this week, 
next week, last month, next month) and assigns this 
number to @Part2 variable. For example, Listing 1 shows 
code that counts the number of days when the speci- 
fied period is next month (i.e, (QC = N and @D = M). 
This code is part of a large CASE 
function in DatesFunction.sql. The 


, 


Michael Berry 


TABLE |: The Matrix 


LISTING I: Code That 


What 
Week 


Month 
Quarter 


Year 


CASE function goes through each of Determines the Number of 


the possible 16 @C and @D combina- 
tions, such as: 

*()C =T and @D = W 

° @C = L and @D = W CREDUNT CO 
* QC =N and @D = W cm 
* @C =P and D = W WHERE 

° @C =T and @D =M 

° @C = L and @D =M 


WHEN aD = 'M' 


END 


AND QC = 'N' 


gedate) 


Days for the NHNM Example 


dte < DATEADD(mm, +1, dedate) 
AND dte >= 


January 2008 


LISTING 2: Code That Determines 
the Base Date 


INSERT INTO ahold 

SELECT ISODate, Dte, Year, 
FiscalYear, Quarter, Month, 
DayOfMonth, DayOfWeek, 
Monthname, DayName, Week, 
IsWeekday, IsHoliday, 
HolidayDescription,EndOf 


FROM 
CALENDAR 
WHERE 
dte = (DATEADD(dd, APart2, dedate)) 


LISTING 3: Code That Determines 
the Beginning Date for the NHNM 
Example 


WHEN @D = 'M' 

(SELECT 
MIN(Cdte) 

FROM 
Calendar 

WHERE 
CMonth] = 
AND [year] = 


THEN 


(SELECT [month] FROM Ahold) 
(SELECT [year] FROM ahold)) 


LISTING 4: Code That Determines 
the Ending Date for the NHNM 
Example 


WHEN 9D = 'M' 
(SELECT 
MAX (dte) 
FROM 
Calendar 
WHERE 
[Month] = 
AND [year] = 


THEN 


(SELECT Cmonth] FROM dhold) 
(SELECT [year] FROM ahold)) 


Next, the Dates function 
determines the base date. The 
best way to explain the base 
date is through some examples. 
To determine the base date, the 
function uses the last two char- 
acters in @Parm and the date 
in @eDate. For example, if the 
specified period is last week (@ 
C = Land @D = W) and the 
current date is 12/31/2007, the 
base date would be 7 days ago, 
or 12/24/2007. If the specified 
period is next week (@C = N 
and @D = W) and the current 
date is 12/31/2007, the base date 
would be 7 days in the future, or 
01/07/2007. As Listing 2 shows, 
the function adds the number 
of days in the specified period 
(@Part 2) to the current date 
(@eDate) to get the base date. 
The function then retrieves all 
the fields from the Calendar 
table for that date and assigns 
the data to a table variable 
named @hold. Although all 
the fields aren’t necessary for the 
purposes here, I added them in 
case I want to add more func- 
tionality in the future. 


Share Your 


Experiences 
Share your SQL Server 
code, comments, discoveries, 
and solutions to problems. 
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Because @hold contains all the fields, the Dates 
function uses a SELECT statement to retrieve just the 
date (te, the value in the dte field), which it assigns to 
the @HoldDate variable. The function uses @HoldDate 
to calculate the beginning date and ending date for the 
requested specified period and sets those dates to the @ 
BaseStartDate and @BaseEndDate variables, respectively. 
Listing 3 shows how the function calculates 


it. For example, 
Figure 1 shows 
the interface for 
a VB 6.0 applica- 


LISTING 5: Code That 
Finds the Target Date for 
the NHNM Example 


: IF 8B = 'H' AND 8A ='N! 
tion I created for BEE 
developers at my SET @current = 
(SELECT 

company who MINCisodate) 

, FROM 
want to use the ddaytype 
Datesfunction in WHERE 


dte > gholddate 
AND isHoliday = 1) 
END 


their programs. 
After the devel- 
opers make their 
selections in the 
interface, the application displays the appropriate SQL 
SELECT statement in the SQL Syntax textbox so that 
they can copy and use it. The application also returns the 
value for that date so that they can make sure they made 
the correct selections and that the results are as expected. 
In Figure 1, notice that there are a few more options 
compared with the options in the matrix in Table 1. The 
Dates function in DatesFunction.sql is more generic than 
the Dates function used at my company so, for example, 
the trade day options you see in Figure | aren’t in Dates- 
Function.sql. 

For me, the Dates function has proved its usefulness 
countless times because it’s so versatile. You can use it 
for just about any type of date that’s important in your 
environment (eg. financial closing dates, processing 
dates) by adding those dates to the Calendar table and, if 
needed, updating the matrix and DatesFunction.sql. The 
possibilities are endless, and I'd love to see any updates 
you make to the Dates function. You can contact me at 
michaelberry67@yahoo.com if you have questions about 
the function or you want to share your version of it. EA 

— Michael Berry, Senior DBA, 
Ohio Public Employees Retirement System 
InstantDoc ID 97590 


the beginning date and Listing 4 shows how 
the function calculates the ending date for 
the NHNM example. The code excerpts in 
both listings are part of large CASE func- 
tions in DatesFunction.sql. 

With the beginning and ending dates in 
hand, the Dates function creates a working 
table. The Dates function then uses the 
working table along with the values in the 
@A and @B variables to obtain the target 
date. Remember that, in this example, the 
target date is the next holiday next month, so 
@A is N and @B is H. Thus, the function uses 
the code in Listing 5 to find the target date. 


Staing Date 
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= [BSCalendar 


Cr 
| 9/10/2007 =] 


new 2007-09-03 
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(^ Trade Day C Lat 
Non Trade Day 


Hobday 


TRADE DAY 
C LAST 


C Next 
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SQL Syntax. [select dbo cal dates LHTM 9/10/2007." 0} as rar 


You can create a Visual Basic (VB) appli- Figure I 
cation that provides an interface for the Dates 


function so that other people can easily use 


The interface for an application that helps developers use the 
Dates function 
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For SQL Server consolidation, 
there's only one solution you 
need to know. 


HP PolyServe Software for Microsoft? SQL Server" is the only 
software solution designed specifically for consolidating your 
mission-critical SQL Server databases. HP PolyServe Software's 
Dynamic Rehosting feature provides instance mobility, optimizing 
capacity allocation and simplifying infrastructure administration. 
For IT administrators, HP PolyServe Software dramatically 
increases control over essential tasks, such as: 


Reducing costs: Consolidate to a dramatically smaller server and storage 
footprint by stacking multiple default and named instances onto fewer servers 


Expanding capacity: Easily add new servers or storage, and automatically 
provision new instances, in seconds 


Reallocating resources: Promote a SQL Server instance to a larger server 
in less than 30 seconds 


Maximizing uptime: Simply, easily configure high availability services for 
all SQL Server instances 


Minimizing maintenance windows: Perform rolling patches and 
updates while minimizing instance offline time to seconds 


With HP PolyServe Software, IT 
organizations can improve SQL Server 
management while attacking the 

costs associated with large database 
deployments. Customers can: 


* Dramatically reduce server count 


e Slash cluster configuration and 
management time 


* Virtually eliminate the cost of high 
availability 


* Realize significantly lower total cost of 
ownership for SQL Server 


"With HP PolyServe, manual 
build time has been automated 
from days to hours and failover 
time has been reduced fivefold. 
System management is much 
more efficient." 


- David Miller, global solution 
director, Avanade Inc. 


Visit www.hp.com/go/polyserve 
Call 1-877-476-5973 


Technology for better business outcomes. 
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Enhance Reporting Services with 
the technology of the future 


Data Visualization technology coming to 
SQL Server 2008 is available now from Dundas. 


With Microsoft implementing Dundas's line of products into SQL 
Server 2008 Reporting Services, why wait for advanced data 
visualization capabilities, when you can have them today? 


Dundas Chart, Dundas Gauge, Dundas Map and Dundas Calendar for 
Reporting Services offer unique, seamlessly integrated data 
visualization functionality that enhances the user experience in 
SQL Server Reporting Services 2005. These four products are 
included in the Dundas Dashboard Bundle for Reporting Services, 
giving you all you need to turn your reports into visually appealing 
dashboards and scorecards quickly and easily. 


All the work you do today with Dundas technology for SQL 
Reporting Services 2005 can be migrated to SQL Server 2008 when 
it is available, so work performed today can be reused tomorrow. 


Download full evaluation copies today and add advanced == ' d | Rl FEY 
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My PerformancePoint 
Server Wish List 


PPS offers strong Bl features but Microsoft 
needs to better integrate components 


icrosoft Office PerformancePoint Server 2007 

(PPS) has now settled into the market, and 
customers who need a consolidated business intelligence 
(BI) and performance management platform are well 
advised to consider adopting it. (For more information 
about PPS, see “What Do You Care About Perform- 
ancePoint Server?" August 2007, InstantDoc ID 96367, 
and the Microsoft PerformancePoint Server Developer 


Portal at msdn2.microsoft.com/en-us/office/bb660518 


„aspx. An upcoming article by Craig Utley in SOL Server 
Magazine dives deeper into PPS as well.) Future releases 
of PPS will arrive close together as Microsoft works to 
better integrate the various components. Looking to those 
future releases, here’s my list of top requests for changes 
Td like to see Microsoft make to PPS. 

Consolidate the environment. PPS doesn’t have a 
consolidated environment for developing in the Monitor, 
Analyze, and Plan components. Now we have Dashboard 
Designer, the ProClarity tools, and Planning Business 
Modeler. Please bring them together. 

Simplify installation. Installation isn’t always a snap, 
and it gets tricky for distributed scenarios. It requires 
setting many permissions in different places, making sure 
Kerberos security is working correctly, and manipulating 
Service Principal Names (SPNs) for services accounts 
(setSPN.exe) to name a few tasks. 

Add support for report items. In the Monitoring and 
Analysis areas, there’s no support for outgoing filter links 
on report items in dashboards. We need this support. 

Add an “action” feature to Key Performance Indicators 
(KPIs). This feature could be similar to an Analysis Ser- 
vices Action that lets you launch another PPS view, open 
a SQL Server Reporting Services (SSRS) report, and jump 
to another application when you select a KPI. 

Enable sharing of dashboard filters. Dashboard filters 
arent First Class Objects. Please change that so they can 
be shared across dashboards and so we can pass values 
from one dashboard filter to another. 

Add finer control over dashboard layout. Too much 
dashboard real estate is wasted (e.g., dashboard filter 
drop-downs are hard coded at 400 pixels wide in tree 
and multi-select layouts) irrespective of data contained 
therein. 

Add support for passing multiple Time Intelligence 
( TI) filter values from multiple data sources to the same 
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scorecard. Td like to see added support for building a 
scorecard with Actual sourced from an OLAP cube and 
Budget sourced from a tabular data source. Currently TI 
filter values are only applied to one data source. 


In the Monitoring and Analysis areas, I'd like to see 
Microsoft remove Office Web Component (OWC) depen- 
dencies in all the report types. Here’s what I’m hoping for 
in support features: 

* More ProClarity Analytic Server (PAS) chart types as 
well as support for PAS multi-chart capability. 

* Support for sparkline creation (i.e, Edward Tufte's con- 
cept of embedded high resolution graphics the size of 
the text around them) in scorecards and reports. 

* Completion of ProClarity product integration. 


In the Planning area, I'd like to see Microsoft add the 
following features: 

* Many-to-Many dimensions support. (Not all Cost 
Center dimensions require budgeting for all Expense 
Account dimensions, and there's no clean way to link 
the two dimensions to display only the relevant Expense 
Accounts for each Cost Center.) 

* Graphical support for workflows. 

* An interface that helps a financial analyst implement a 
business rule without having to learn T-SQL, MDX, or 
PerformancePoint Expression Language (PEL). 

* Simple synchronization 
with SQL Server Analysis 
Services (SSAS) dimen- 
sions already in existence 
on SSAS servers so you 
don’t need to re-create 
them in PPS and then 
maintain them manually. 

* Visualization capability 
in the Application/Model Site/Model hierarchy BPM. 

* Ability for end-users to add Dimension members 
from a Microsoft Excel interface (a common customer 
request that might be opening Pandora's box). 


Special thanks to PPS experts at Solid Quality Mentors for 
their contributions: Sony Jose, Alejandro Leguizamo, Peter 

[SQL 
InstantDoc ID 97563 


Myers, Craig Utley, and also Nick Barclay. 
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Douglas McDowell 
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consolidated environment 
for developing in the 
Monitor, Analyze, and 
Plan components. 


January 2008 


I5 


Anne Grubb 


agrubb @ windowsitpro.com) is Web site 


strategic editor for Windows IT Pro and 


SQL Server Magazine. 


with Style, 


a SQL Server professional, you’re probably used to fulfilling end-user requests and 
keeping your databases healthy while mostly escaping the notice of your non-IT co- 
workers—unless, of course, the server goes down or users can’t access the database. 
But at SQL Server Magazine, we think you might be underappreciated for all the 
work you do—which is why we started the SQL Server Magazine Innovators Awards 
program. These awards recognize SQL Server pros who have applied their technical 
skill and ingenuity to automate processes, ensure system availability, and give users 
the information they need to do their jobs and advance business goals. We hope that 
the solutions from this year's award winners will inspire you to develop your own inno- 
vative solutions—which we encourage you to enter in next year's Innovators contest! 
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GRAND PRIZE 
Joseph Krynicky 


After more than 30 years as a programmer, Joe 
Krynicky was ready to retire from his job, but not 
from solving programming challenges. He and 
some colleagues had an idea for a video poker 
game that incorporated a few twists on the arcade clas- 
sic and formed a company, Kirei Technology, to de- 
velop and market the product. They found a company 
that would buy their idea if Kirei could program the 
math for the game: the poker-hand simulations needed 
to create pay tables. (A pay table is the amount that the 
game returns to a player for each winning hand.) 


President, Kirei Technology, Roselle, New Jersey 
joseph. krynicky@kireitechnology.com 


SQL Server Calculates Video Poker Payouts 


Joe talked to gaming-industry math experts, but 
none of them would take on the problem since the 
game had more cards (six instead of five) and winning 
hands than the traditional video poker game. “With 
[our game], it would take weeks of computer time for 
the evaluation of each pay table using the traditional 
simulation methods, because of the millions of pos- 
sible combinations of hands,” Joe said. 

Joe thought that SQL Server might offer a way 
to perform the needed calculations in a reasonable 
amount of time. Typically in video poker, the best way 


SQL Server Magazine * www.sqlmag.com 


Ingenuity and solid database skills 
meet in the 2007 Innovators 
award-winning solutions 


to play each hand is determined by calculating the ex- 
pected value for each combination of cards kept and 
discarded from the dealt hand and selecting the best 
value for the player. “But we said, these are the winning 
hands; what are the different ways to get there? And we 
went through all the different strategies. For example, if 
you're dealt a full house, you're going to keep it. But if 
you're dealt three cards in an inside straight, and a low 
pair in the same hand, what do you do?" 

The solution that Joe devised uses about 200 SOL 
Server tables to contain the various hands and player 
strategies. ^We had a SQL table containing a row for 
each possible hand of dealt cards, 27 tables of all the 
winning combinations in the game and how much was 
paid for each winning hand, and then we had about 
100 tables containing rows for each hand of cards fit- 
ting specific starting card-playing strategies," Joe says. 

Although there are more than 120 million possible 
hands, they break down into certain similar groupings, 
and Joe used these as the basis for the tables. “For in- 
stance, we have a table containing all hands that con- 
tained two jacks or higher and a table containing all 
hands that contained three of five cards that could be 
used for a straight,” Joe says. “These tables were creat- 
ed once at the beginning of the process, so that much 
of the repetitive processing wouldn't need to be per- 
formed multiple times later in the iterative portions of 
the processing." 

After the tables were created, the next task was to 
write the program that calculates the pay table. The 
potential game buyer wanted a 98 percent return— 
that is, the player would get 98 cents back on every 
dollar bet on the game. As Joe explains, his team 
wrote a two-step T-SQL stored procedure that cal- 
culates the return to a player by joining the table of 
all possible hands against tables containing all hands 
that match each hand-playing strategy, in descending 
order of percentage return (e.g., a dealt royal flush 
has the highest-percentage return for any hands), one 
strategy at a time. “For each strategy, the percentage 
return of the strategy is multiplied by the number of 
records returned from the join, and this amount is 
added to a running total of money won by the player. 
The records from the join with each strategy table are 
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then removed from the remaining hands table, and 
the next highest strategy is joined to the remaining 
card table after the previously played strategies were 
removed. These steps are repeated until all possible 
hands have been evaluated and the table of remaining 
cards contains no rows. The running total of amount 
won is divided by the total number of hands evalu- 
ated, and the resulting amount is the percentage of 
money bet returned to the players. The percentage of 
money not returned to the players is the hold percent- 
age for the machine manufacturer." 

Innovation is at the essence of the solution that 
Joe and his colleagues devised. They took a seemingly 
complex math-calculation problem and reformulated 
it into a series of set operations that can calculate a 
new pay table in about two hours—far more quickly 
than a simulation program that processes each of the 
millions of records individually multiple times. “This 
shows that the SQL language isn't just useful for stor- 
ing and analyzing data, but it can solve math problems 
as well," Joe said. *Without this solution, we wouldn't 
be able to sell our company's video poker game." 


Runner-Up 


David Dye 
Sergeant/DBA, 
Cape Coral Police Department 

Cape Coral, Florida 


ddye@capecoral.net 


Streamlining Data Flow 
Among Applications 

For all the automation time savings that soft- 
ware packages provide, ironically, IT may spend a 
great deal of time on keeping data for those applica- 
tions updated. “Like many organizations, my agency 
had collected an overabundance of software packages 
that were put into action to streamline and consoli- 
date our data flow, but as new programs were imple- 
mented, little thought was put into the integration of 
these systems,” says David Dye, a sergeant and DBA 
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with the Cape Coral, Florida, police department. 
For example, IT staff for the department needed to 
manually maintain information for about 700 public- 
safety-department employees in seven separate appli- 
cations, including Active Directory (AD), a process 
that was prone to data entry error. 

David's involvement with IT for the police de- 
partment started about five years ago, when he 
was assigned as the project lead to implement new 
computer-aided dispatch (CAD) and records man- 
agement systems. Several years later, when David's 
job duties had expanded to include SQL Server 
database reports and integration tasks, he and the 
network administrator, Matthew Vilord, were dis- 
cussing the ongoing problem of having to manually 
update employee records in the various applications. 
“We decided we needed a starting point where [the 
information] could just trickle down [to all the ap- 
plications]. AD seemed like the most logical place to 
start. We'll go in and we'll replace a user within AD, 
create a Windows account, then move down through 
the other applications." 

David's first step in consolidating and automat- 
ing application-data administration was to inven- 
tory the existing systems and data flow between them. 
Since most of the applications used SQL Server as 
their back-end database, David decided to use SQL 
Server as the basis of his solution. He created a chart 
of data-flow processes, beginning with adding a new 
user into AD, and charted the progression of adding, 
changing, or removing users throughout the agency 
and information that could be passed between sys- 
tems, rather than entered manually. "After I created 
a comprehensive flow chart, I determined that it was 
feasible to create a set- 
based solution that used 
AD as the starting point 
and trickled the informa- 
tion down throughout 
our data infrastructure." 

Next, David identi- 
fied additional data-flow 
functionality that the 
system needed. He opted 
to run a separate physical 
server—which he created 
from three computers 
seized from a drug dealer—running a separate instance 
of SQL Server. To get production-environment infor- 
mation onto the new server, David created a stored 
procedure that queried the maintenance plans of the 
production servers—which provided the most recent 
transaction-log backup—and restored that backup to 
the new server. “I owe much of the work [in creating 
the stored procedures for the solution] to Itzik Ben- 
Gan's book, Inside Microsoft SOL Server 2005: T-SQL 


x 
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Querying," David says. He then created a job that used 
this stored procedure, which ran hourly 20 minutes 
after the log backups. The new SQL Server instance 
now had databases that held information from the pro- 
duction environment, to be used for reporting and for 
centrally performing data-updating tasks across all the 
applications. 

The existing system lacked a means for notifying us- 
ers of certain transactions, such as the status of police 
reports. “Department personnel were required to log 
into numerous applications to find such notifications, 
if they even existed, David says." To address this need, 
David wrote stored procedures that collected informa- 
tion from the backed-up transaction logs and put them 
in a temporary table. “Then, utilizing a cursor and the 
xp. smtpsendmail procedure, written by Gert Drapers, 
I [created a procedure that] emailed the notifications to 
employees, based on time limits denoted in IF BEGIN 
clauses. I placed these stored procedures into SQL jobs 
and scheduled them to run daily." 

The solution provides multiple benefits for depart- 
ment users. “We’ve been able to substantially reduce 
the personnel hours spent on maintaining separate 
data sources, so that [employees can] serve their pri- 
mary job function rather than entering redundant 
data in numerous application front ends," says David. 
Another benefit is the consistency in data replicated 
among the applications. And the functionality that 
David added—most notably the stored procedures 
that email notifications—made it much easier for 
employees to obtain the up-to-date information they 
needed on the status of various reports, overtime re- 
quests, and subpoenas. 


Runner-Up 


J 


Timothy Ford 
Senior Database Administrator, 
Spectrum Health 

Grand Rapids, Michigan 
timothy. ford@spectrum-health.org 


High Availability for a 
Critical Hospital System 

High availability of essential applications is vital for 
any business, but nowhere more so than a hospital, 
where patients’ lives depend on systems being avail- 
able 24 x 7. Although the Oracle-based electronic 
medical records system at Spectrum Health had plenty 
of redundancy, physicians and staff at the healthcare 
center’s six surgical centers wanted further assurance 
that surgical-staging data—data that describes how 
to set up a surgical room for a specific surgeon and 
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surgery—would always be available on site in the surgi- 
cal centers, even if the network went down. “We found 
that we needed to have something available, in case 
there was a failure with that central system, to keep 
surgeries going on and ensure that an OR is staged the 
way a surgeon wants it staged, so an operation goes as 
smoothly as possible," says Tim, the senior DBA with 
Spectrum Health for about eight years. 

To meet this requirement for additional redundancy, 
Spectrum’s Oracle DBA originally enlisted the help of 
a colleague to develop an extract from the Oracle rela- 
tional database management system (RDBMS), which 
he bulk-loaded into a standalone instance of Oracle on 
a dedicated PC in each surgical center biweekly. The 
data was available via a Microsoft Access front end 
consisting of two forms and a report. However, the 
loading process failed frequently because employees in 
the surgical units often shut down the PCs, not know- 
ing what the dedicated PCs were being used for and 
that they were supposed to stay on all the time. 

"When I took over support of this process, I 
looked into streamlining the solution, knowing that it 
had to be scalable because we had plans to bring oth- 
er surgical centers online," Tim says. “I also wanted 
to add monitoring functionality and notification on 
failure." Tim opted to use a SQL Server database to 
provide the redundancy, along with a DTS package 
for exporting the data from Oracle into SQL Server. 

The solution is straightforward, as Tim explains. 
*We developed extracts out of the main Oracle sys- 
tem that were specific to each of the surgical centers. 
A DTS package ftps the extracts [flat files containing 
surgical-staging information] from the Oracle RD- 
BMS to our SQL Server 2005 Enterprise cluster. A 
transformation task loads the data into two tables: a 
reference table for the various medical supplies and 
the actual surgical preference cards, as they're referred 
to in our system. The data in each surgical center re- 
sides in a SQL Server 2005 Express Edition database 
on a dedicated workstation, and the Access file used 
for the original Oracle instance was relinked to the 
new SQL Express local instance. A second transfor- 
mation task pushes data from the central database to 
each surgical center's database. This DTS package is 
scheduled to run weekly as a SQL Server Agent job, 
which notifies me via email upon job completion." 

Since the staging data changes only about once a 
week, the process of extracting the flat files from the 
Oracle database and transferring them to SQL Server 
occurs at the beginning of each week. Tim's solution 
also monitors the dedicated workstations to make 
sure they're running, using a solution he developed to 
track the 70 SQL Server instances hosting all 800-plus 
databases across the medical system's domain. “Using 
linked servers and by querying system tables, I track 
backup history, SQL Agent history, file space, and 
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other select metadata. SQL Server Reporting Services 
(SSRS) then provides me with daily delivered and 
on-demand reporting of this metadata. I use SMTP 
trapping to notify me if one of the monitored SQL 
instances is unresponsive—for instance, if someone 
has turned off a server," Tim says. 

The solution meets the need of surgical staff to 
have guaranteed uptime of the staging system. Tim 
says he's in the process of converting the monitoring 
system to a solution similar to the one that SOL Serv- 
er Magazine contributor Rodney Landrum describes 
in his recent articles about SQL Server Integration 
Services (SSIS) and SSRS. (For more information, 
see "SOL Server Integration Services" May 2007, 
InstantDoc 95385 and “SQL Server Reporting Ser- 
vices," June 2007, InstantDoc ID 95745.) It's good to 
see one of our authors inspiring an Innovators award 
winner to innovate even more! 


Runner-Up 


Maurice Pelchat 
SQL Server Specialist, 
Société GRICS 
Montreal, Canada 
pelchatm@grics.qc.ca 


Download an article by Maurice Pelchat 
that explains his solution in more detail at 
www. sqimag. com, InstantDoc ID 97594. 


Database Maintenance 

for the Masses 

Société GRICS, a company that develops applica- 
tions and provides training and consulting services for 
school boards and other markets throughout Quebec, 
needed a way to enable nontechnical end users to per- 
form routine SQL Server maintenance. Although the 
school boards have part-time DBAs who maintain 
their databases, staff outside the school boards didn't 
know how to do any maintenance other than sched- 
uled backups through SQL Server Agent. 

As Société GRICS’ SQL Server specialist, Mau- 
rice knew that the ability to perform routine database 
maintenance was essential to ensure that appli- 
cations ran smoothly and to avoid data losses. 
He also noticed that support-call problems 
were increasingly related to inadequate data- 
base maintenance and saw a need for a reliable 
database-maintenance solution that all Société 
GRICS customers could use. The solution would 
need to perform database-integrity testing, selective 
index reorganization, statistics updating, regular full 
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database and log backups, cleanup of old backups, 
and cleanup of SQL Server logs and history logs, 
all without IT involvement. *Being a T-SQL addict 
myself and having some knowledge of how database 
maintenance works, I envisioned ways to set up all 
this in a single T-SQL solution," says Maurice. 

The solution Maurice envisioned would meet the 
needs of both end users and IT. The solution's main 
requirement was that it had to run without affecting 
system performance or users' ability to access data. 
Additionally, says Maurice, “the tool’s only [prereq- 
uisite for a user to run it] would be a working SQL 
Server Management Studio (SSMS) query window. 
The tool needed to log all its actions and store the log 
in a SQL Server database. The solution should config- 
ure everything necessary to run by itself and require 
a minimal set of parameters so it would be easy to 
use, even for non-IT people. Finally, it should provide 
daily maintenance reporting, disable access to a spe- 
cific database in the event integrity problems occur, 
and be easy for IT to customize." 

Using SQL Server 2005, Maurice wrote a T-SQL 
solution that includes a script that end users down- 
load from the support site, paste into an SSMS query 
pane, and launch. The script creates a maintenance 
database that includes log tables and a stored proce- 


dure that initiates the various maintenance tasks. The 
solution relies heavily on the use of dynamic queries 
to perform tasks such as obtaining information about 
a particular maintenance process for reporting, job 
scheduling, and error handling. Also within the script 
are examples that users can customize—one a call to 
the setup stored procedure that specifies email recipi- 
ents and the mail server to use to send them mainte- 
nance messages, and the other a sample backup direc- 
tory for database backups. 

“SQL Server 2005 includes decent T-SQL excep- 
tion handling, which made it easy to do everything 
the solution required," Maurice says. “Long strings 
in varchar(max) datatype ensured that I didn't have 
to worry about the length of dynamic queries needed 
for the solution. This also makes it easy to store T- 
SQL queries and error messages into the log tables." 
By implementing Maurice's user-friendly database- 
maintenance solution, IT support staff at Société 
GRICS can be sure that users will perform database 
maintenance setup according to their best practices 
wish list, preventing data losses while ensuring that 
applications will run properly without performance- 
degradation problems related to poor database 
maintenance. SOL} 
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ServiceU gains 9999976 uptime, projects $900,000 in benefits, 


and 59576 return on investment thanks to Dell and Microsoft solution 
li Mj emphis-based ServiceU, in business since 1997, is card information was getting out on the internet, so the credit card 
| N 4 P la software on-demand service provider (formerly industry got together and created a cohesive data security standard. 

; known as an application service provider or ASP) Today anyone that processes credit cards over the internet is responsible 
which delivers Web-based software for box office for meeting PCI requirements,” says Smith. "As a PCI Level | service 
management, event management, ticketing, and provider, we have annual security audits to demonstrate compliance with 
event registration for churches, schools, businesses, the PCI data security standard. PCI is very specific about backup facilities. 

and other organizations. It serves more than 1,000 organizations world- ^ Before a secondary facility can go online, a PCl-compliant company must 
wide, ranging from Fortune 500 companies to public universities and assure that all systems meet the same data security standards as those 
small, non-profit institutions. It has customers in all 50 states in the implemented at the primary data facility. The disaster recovery plan in 
US, and in 15 countries. The company's software has been used to place prior to the Dell solution involved the use of tapes, and called for 
handle scheduling for more than 12 million events. Through its own physical tapes to be sent by helicopter between facilities. It could have 
Web-based software, ServiceU provides a wide variety of services taken days or longer for the company to recover from a possible disaster: 
to its clients, including online ticket sales, box office management, Faced with the requirement of always-on availability, quick disaster 
event scheduling, room and resource scheduling, online calendars, recovery, and compliance with PCI Level | Data Security Standard (DSS), 
and email newsletters. Organizations can pick and choose from these ServiceU realized that it needed to build a better disaster recovery plan. 
services Via a Web-based control panel, and they pay only for the 
services they use. At the core of ServiceU's computing infrastructure ServiceU CHOOSES THE DELL $ ION 
are Dell PowerEdge database servers with dual Intel® Xeon® After a detailed ch Nm GT. that the ideal solution 
processors, running Microsoft SQL Server 2005. ServiceU relies on a would be to mirror the databases from its main facility to its disaster 
fully redundant Dell/EMC SAN for its database storage. The solution recovery facility. In the event of an outage at its main facility, it could 
is configured as a database cluster at each location, using Microsoft then immediately cut over to the disaster recovery facility, which would 
clustering, to provide high availability during software and hardware have an up-to-date copy of the data. ServiceU considered several 
updates or in the case of a problem with one of the servers. database mirroring solutions. One solution would have required over 
$100,000 in setup costs, would have necessitated additional ongoing 
lias ere GE: EY ANDI E We licensing costs and could have created significant integration issues. 
PROVID VAYS-ON AVAILABILITY AND | ST RECOVERY 
The databases, which run on Del er Edge servers, are the most ServiceU instead turned to Dell and Microsoft SQL Server 2005 
important strategic asset the company owns. Always-on availability and with Database Mirroring, in order to save $100,000 in costs, solve 
ServiceUs Web-based software are the key to the company’s success, integration issues, and to have a single vendor to turn to for support. 
including the ability to quickly recover in the event of a disaster" The "Having a single point of contact was essential to us. Whether we 
entirety of our business is done online,” explains ServiceU Chief simply have questions or if there are issues to resolve, we know we 
Technology Officer, David F Smith. "It accounts for all of our revenue, can call Dell and get the answers and resolutions we need..fast,’ says 
so uptime is crucial to us.” ServiceU faces some unique challenges in Smith. ServiceU also chose Dell for the reliability of its hardware, and 
maintaining such high levels of availability. Our Memphis offices sit ontop ^ the high quality of technical support, services, and company expertise. 
of the New Madrid Fault, the site of the largest recorded earthquake ServiceU has been using Dell hardware for eight years, according to 
in the United States, which occurred in the early 1800s,’ Smith says. Smith, and “the reliability of the Dell hardware has been exceptional. 
“According to seismologists, we are within 40 years of another major We've basically had no problems with the hardware at all. Also, from 
earthquake, so we have to be prepared” Adding to the need for Dell Services, we're able to get quick, helpful responses when we need 
a solid disaster recovery (DR) plan are the Payment Card Industry it. We've been extremely happy with both Dell hardware and Dell 
(PCI) standards, which mandate that PCI Level | service providers like Services" "From the time we began planning this project, all the way 
ServiceU meet a rigorous set of DR requirements. "Several years ago, through implementing it, and supporting it afterwards, Dell has always 
there were numerous companies that were being hacked. A lot of credit ^ been there for us. That is very important, because our online business 


is our entire livelihood,’ he adds. 

HOW IT WORKS 

HOW THE SOLUTION WORK 

With Dell Services at the helm, the deployment went 
smoothly; ServiceU built a disaster recovery facility in 
Atlanta that mirrors the database in its main Memphis 
headquarters, using Dell PowerEdge servers and 


HARDWARE 

* Dell" PowerEdge™ 2850 servers with Intel? Xeon? processors 
* Dell/EMC CX300 SAN 

* Dell PowerVault" 210 SCSI Disk Storage Enclosure 


SOFTWARE Microsoft 5QL Server 2005 with Database Mirroring. 

* Microsoft? Windows Server? 2003 Enterprise x64 Edition The only significant difference between the two 

e Microsoft® SQL 2005 with Service Pack | Database Mirroring facilities n ieie of the SQL Server cluster is that 
the primary facility utilizes a Dell/EMC SAN while 

SERVICES the secondary facility utilizes Dell PowerVault high 

* Dell Infrastructure Consulting Services performance SCSI disk storage enclosures for the 

* Dell Gold Enterprise Support Services database storage. 


When a user accesses the ServiceU system, the 
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user normally accesses the primary datacenter in Memphis. As changes 
are made to the SOL Server databases in Memphis, information about 
the changes is recorded in the SQL Server transaction logs. The logs 
are placed in a database log buffer, then written to disk, making the 
change to the database. Using Database Mirroring, the server writes the 
database log buffer to disk, and simultaneously sends the log across an 
encrypted network to the database mirror at the Atlanta facility, where 
those same changes are applied to the Atlanta databases. Changes are 
made nearly instantaneously to both facilities. Latency between the 
Memphis and Atlanta facilities is only 10 milliseconds, even though triple 
DES encryption (168-bit Data Encryption Standard) is used. This allows 
for fast, asynchronous mirroring between the two locations. 

Because the sites mirror one another, if the Memphis facility goes 
down, ServiceU can immediately fail over to the Atlanta disaster 
recovery facility, with virtually no down time. Both sites are PCI Level | 
compliant, allowing the Atlanta facility to become the primary facility in 
the event of a disaster 

“Without database mirroring, it could take us days or even weeks 
to restore data from tape, and to implement all the safeguards 
required by the payment card industry for PCI Level | compliance,” 
Smith says. Database mirroring allows us to have the Atlanta 
facility functional, compliant, and ready to use at a moment's notice. 
Additionally, the Dell and SOL 2005 database mirroring solution allows 
us to eliminate risks from natural disasters, such as earthquakes, and 
assure our customers that they will always have the same level of 
service that they rely on.” 


THE BOTTOM LINE FOR SERVICEU 
A detailed analysis of the implementation shows that ServiceU will 
realize a cumulative, projected, three-year net benefit of $908,985 from 
the project, driven by the ability to significantly expand the business 
because of the mirroring solution. The project has a projected RO! of 
595% and a payback period of five months. (same comment as above) 
There are other benefits as well. Applications with high availability can 
now be guaranteed, because if there is a problem or disaster at the 
Memphis facility, the Atlanta facility can immediately take over. In fact, 
customers will not notice that their services are being provided by a 
different facility; the change will be transparent to them. 

Upgrading the database servers with Dell hardware has improved 
database erformance as well, and made it easier for ServiceU to scale 


ROI (Return on Investment) is the percentage return expected over a specified 
period of time. ROI is the total benefit divided by the total costs. This RO! metric 


is good for assessing the multiplier provided by the benefits relative to the total 


investment and costs. 


Net Present Value (NPV) represents the cumulative present value of the 
expected return of a project over a specified period of time minus the initial costs 
of the project. This dollar figure provides visibility on the actual value of a project, 
taking into consideration the time value of money - the ongoing benefit of a project 
in today's dollars. NPV tells you the magnitude of the project and if the project 


generates a profit. 
Payback Period (or breakeven) is the timeframe it takes for the project to yield 
a positive cumulative cash flow. Payback period is a key measurement of risk but does 


not take into account cash flows after the payback period. 
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to support rapid growth. Before the upgrade, the databases ran on 
Dell PowerEdge 6450 servers with four Intel® Xeon® 700 MHz 
processors with 4 GB of RAM. The servers often ran at up to 6076 
of CPU capacity during peak hours. After the upgrade to SOL Server 
2005, running on Dell PowerEdge 2850 servers, each with dual 3.8 
gigahertz hyperthreaded processors, CPU utilization dropped to just 
four percent. This allows existing servers to handle increased loads. 
New servers can easily be added to the clusters, making it extremely 
easy and cost-effective to scale up with new hardware. 


Perhaps most importantly the implementation of the new solution 
has enabledexpansion into new markets, particularly the largest 
venues that might not have previously considered using ServiceU. 
"Our Dell and SQL Server Database mirroring solution provides 
always-on, reliable access to ServiceU's on-demand software,” Smith 
says. "Coupled with the PCI Level | compliance, it has opened up 
new market segments for us. The potential is there for millions 
of dollars in increased business." 


i | t 
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TOTAL PROJECT COSTS $197.125 $15,187 $15,187 $15,187 
NESS EXPAN N $ Dr Sarl Ì 
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ROI, NPV and Payback should be used in conjunction to understand the rate, 
size and timing of the return. 


Net Value (or Net Benefit) is the benefit delivered to the organization for the 
investment made in the project. Net Value is calculated by taking the total benefit 


minus the project costs. 


Internal Rate of Return (IRR) is the implied rate of return of an investment 
assuming complete reinvestment of cash flows. It is the percentage rate by which 
you have to discount the benefits until the point that they equal all the costs. IRR is 


calculated as the discount rate necessary to drive the NPV to zero. 
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Data Warehousing: 


Slowly 


Chang ing 


DIMENSIONS 


When change occurs in your data warehouse, 


how will you react? 


C hange is inevitable; nothing stays the same for 
long. That's why such careful precautions are 
taken to minimize the impact of change in 
transactional database design. We choose primary key 
candidates, which have the least possibility of being modi- 
fied, because we know the complexity that's involved in 
changing a primary key value in a typical OLTP database. 
Change even happens in data warehouses, especially in 
data warehouses whose sole purpose is to archive his- 
torical data. In fact, historical archiving mandates that you 
have a scheme in place to capture changes that will happen 
to people, places, and things as time passes. 

In data warehousing, were faced with developing 
templates or standard ways of defining and addressing 
content changes in the data warehouse. You’ve probably 
heard of slowly changing dimensions, which are dimen- 
sions whose content changes over time. I’m not talking 
about just adding records to the dimension; I’m talking 
about changing existing records. Although this seems 
counterintuitive in a data warehouse environment, it’s not 
an unusual situation, and it’s often resolved by modeling 
the change on a sequence of templates. Which template 
you use depends on the kind of slow change your data 
warehouse dimension content is experiencing. 


Your Response to Change 

When change happens, how will you react? With slowly 
changing dimensions, you can respond in one of three 
ways: you can overwrite old data with new data (I call 


TABLE |: 


DimEmplD EmplD EmpFirstName EmpMiddlelnitial 


this a type 1 response), you can create a new dimension 
record for the time period that defines the change (I call 
this a type 2 response), or you can create an “old value” 
column in the dimension record to store the previous 
value (I call this a type 3 response). The response type you 
choose will depend on your organization’s requirements 
for maintaining and archiving data. 


Type I Response: Overwrite the 
Old Data Value 
This response type involves overwriting the old data value 
when the old value has no significance and can be dis- 
carded, such as when you're correcting an error. Typically, 
you've written the extraction, transformation, and loading 
(ETL) routines correctly, so there shouldn't be any errors, 
but despite our best efforts, mistakes happen sometimes. 
Before you decide to respond to a slowly changing 
dimension by overwriting the old data value, make 
sure that you can discard a previous value. Some 
organizations, such as financial and audit organi- 
zations, are so bound by compliance requirements 
that overwriting the old data value isn't an option. 


Type 2 Response: Create a New 
Dimension Record 

This response type is useful when you have audit trails and 
other changes that neatly partition history. For example, 
prior to 12:14:55 A.M. the flow converter was running at 95 
percent capacity; after this time it was operating at only 50 


EffectiveDate and EndDate Columns in a Type 2 Slowly Changing Dimension 
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EffectiveDate EndDate 


1 PMA42628M Paolo M Accorti New Hire-Job Not Specified 10 8/27/1992 11/26/1992 
2 PMA42628M Paolo M Accorti Sales Representative 25 11/27/1992 11/30/1994 
3 PMA42628M Paolo M Accorti Sales Representative 15 12/1/1994 6/2/1999 

4 PMA42628M Paolo M Accorti Marketing Manager 120 6/3/1999 NULL 
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SLOWLY CHANGING DIMENSIONS 


percent capacity. Adding a record to capture this change in 
flow rate is the technique most often used to track measur- 
able values, such as employee job performance, customer 
status, and product availability. To effectively partition 
time so that there's no overlap in the periods measured, 
add an EffectiveDate (i.e, the date/time this change first 
appeared) column and an EndDate (after which date/time 
this value is no longer valid) column to each record, as 
shown in Table 1, page 27. 

Note that in Table 1, the current condition (i.e, the 
current job description) is represented by the row in which 
the end date is NULL. As you recall from transactional 
database design theory, NULL can mean that at the time 
the measurement was taken there was no value; that there 
might have been a value, but at the time, no one knew what 
that value was; or that the measurement wasn't applicable 
to this record. In this case, there's no value for the end date 
on record number four because that record represents the 
current situation. 

Before using a type 2 response to change, make sure 
that the data mining software your company is using 
can understand and compensate for NULL—not every 
product can. If you determine that you can't use NULL, 
leave the end date as an empty string (which SQL Server 
2005/2000 will convert to a value of 1/1/1900 if you're 
using a datetime data type) and add another column called 
CurrentRecord that can be flagged on or off. 

Don't confuse the dates in this slowly changing dimen- 
sion with the dates in any associated fact table. The dimen- 
sion dates are used to partition sets of records into time 
slices. It's not appropriate to join these dimension dates to 
the dates in a fact table. 

When you're querying a type 2 dimension and the query 
keys on an identifier that represents just a single time slice, 
then you can expect only a single record to be returned. If 
you query attributes that aren't part of the slowly changing 
dimension criteria, multiple records will be returned. 

When employing a type 2 response, you must use a 
surrogate (e.g., the SQL Server IDENTITY property) for 
the primary key because you'll have multiple versions of 
the same record as that record changes over time. I don't 
recommend trying to use a meaningful natural key concat- 
enated to a date/time value as a dimensional primary key. 


Type 3 Response: Create an Old 
Value Column 

“Soft” changes (i.e, tentative changes or changes resulting 
because you want to track a single attribute value for a 
limited time—examples of soft changes might be sales 
regions or geographic areas) lend themselves to a type 3 
response. In this design, you create an additional column 
in the slowly changing dimension for the old value. When 
change happens, just copy the current value into the old 
value column (e.g., Old Discount Percent in Web Table 1 
at www.sglmag.com, InstantDoc ID 97409) and insert the 
new value into the current value column. There's no need 


to create a new dimension record. The type 3 response is 
best used when the time slices induced by change aren't 
clear-cut (in other words, the change was gradual) or 
where the time slices overlap. 

The benefit to using a type 3 response is that all 
production applications will continue to return the most 
current results, with no need to modify any queries. You 
can access the previous value by creating a new query that 
refers to the old value column. If you want to incorporate 
a limited history, add another column called Change Date 
with a default value of getdate() or current timestamp, as 
shown in Web Table 1. Then you can not only access the 
previous value, but also see when the change occurred. 

The problem with using a type 3 response is that when 
you have more than one soft change per dimension, the 
table schema begins to get very messy, especially if you're 
tracking when each change happened. The row size in bytes 
can quickly grow, adversely affecting file I/O and adding 
to the length of time necessary for query responses and 
joins. If you have multiple soft changes in one row of the 
slowly changing dimension, then you must strictly adhere 
to strong naming standards for the old value and Change 
Date columns. Failure to do so could result in confusion 
and erroneous data on your reports. This response type is 
best used with a single soft change for each dimension. 


Rates of Change 

This discussion of slowly changing dimensions wouldn’t 
be complete without mentioning the rates of change. 
Although these dimensions are called slowly changing 
dimensions, they don’t always change slowly. Even more 
important, slow change to one organization could be rapid 
change to another. 

When you want to capture change in a dimension, and 
the change is in disjointed time slices, then it’s usually best 
to create a new column to record the change for dimen- 
sions that are a “normal” size, whether they’re changing 
slowly or rapidly. I say “usually” because it’s very hard (if 
not impossible) to set absolute rules for designing data 
warehouses; sometimes you simply have to look at the 
specific situation and make a judgment call. 

What constitutes a “normal” size for a dimension? 
Typically about 300 to 100,000 records. For example, 
a company might have 100,000 employees in its HR 
warehouse, and a value in each employee record might 
be modified once a month. Even if the employee record 
is long (e.g., 2000 bytes), it’s still a good candidate for the 
type 2 response mentioned above. 

Rapidly changing dimensions aren’t too much of a 
problem when the dimensions are small, but how do you 
handle rapidly changing monster dimensions? Rapidly 
changing monster dimensions warrant their own article 
because each design technique is moderately complicated 
and has drawbacks. Next month, I'll discuss how to 
manage rapidly changing monster dimensions. Er 

InstantDoc ID 97409. 
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Read-Gonsisteney 
PROBLEMS, PART 2 


Dive into tangible examples and workarounds 


ast month, in SQL Server Read-Consistency 

Problems, Part 1” (InstantDoc ID 97278), I began 

a discussion about index scans and read-consis- 
tency problems that can develop when one process is 
reading data under the Read Uncommitted isolation while 
another process is inserting data. This month, I'll provide 
tangible examples that demonstrate those problems and 
also suggest workarounds. Be sure to read last month’s 
article as a prerequisite to this one. 


Seeing Is Believing 

TIl first demonstrate how an allocation-order scan can read 
the same row multiple times. Run the code in Listing 1 to 
create a database called testdb and within it a table called 
T1. The T1 table has two columns: cl col is a UNIQUEI- 
DENTIFER column with a default value NEWID(), 
and filler is a CHAR(2000) column with a default value 


of a. The table has 
ORE on the WEB 


a unique clustered 
Download the listings at index on cl col. 
InstantDoc ID 91456. With this row size, 
a page will contain 
four rows at most. Each insert will enter a GUID in cl col, 
and because of the random nature of GUIDs, frequent 
insertions will cause frequent splits in the clustered index. 
Open two new connections (call them connection! and 
connection 2). Run the code in Listing 2, page 30, in con- 
nection 1, then the code in Listing 3, page 30, in connection 
2. The code running in connection 1 simply inserts new 
rows into T1, frequently causing splits. The code running 
in connection 2 has a loop that selects all T1’s data into a 
temporary table and checks whether any rows were read 
more than once. The SELECT statement against T1 uses 
the NOLOCK hint, and if you examine the plan for this 
SELECT INTO statement, you'll see a clustered index scan 
with the Ordered: False property. Remember, this is the 
scenario in which the storage engine might decide to use an 
allocation-order scan. As soon as the IF EXISTS statement 
finds multiple occurrences of rows, the code breaks from the 
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loop and returns the GUIDs that SQL Server read multiple 
times. 

Table 1, page 31, shows sample output I got in connec- 
tion 2 after a few seconds. Remember that the clustered 
index on cl col is unique, so there's no doubt that SOL 
Server read the same rows multiple times. Once you get 
output from connection 2, you can stop the code running 
in connection 1 or run the code in connection 2 again if 
you want to make sure that the first test wasn't a fluke. 

The second test will demonstrate an allocation-order 
scan that misses existing rows. Run the code in Listing 4, 
page 30, to recreate T1 with an additional column that will 
hold an incrementing sequence value, and the Sequence 
table that will be used to produce the sequence values. Run 
the code in Listing 5, page 30, in connection 1, then the 
code in Listing 6, page 31, in connection 2. 

The code running in connection 1 has a loop that pro- 
duces, in each iteration, a new sequence value (1.e., greater 
than the previous by 1) and inserts a new row into T1. As 
in the previous test, the inserts will cause frequent splits. 
The code running in connection 2 has a loop that selects 
all T's data into a temporary table and checks whether 
any sequence values are missing. Again, the SELECT 
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LISTING |: Create Database testdb and Table TI 


SET NOCOUNT ON; 

USE master; 

GO 

-- Create database testdb 

IF DB ID('testdb') IS NOT NULL 
DROP DATABASE testdb; 

GO 

CREATE DATABASE testdb; 

GO 

USE testdb; 

GO 


-- Create table T1 
IEEOBUECTSDIDGUdboS- 
DROP TABLE dbo.T1; 

GO 
CREATE TABLE dbo.T1 
C 


'U') IS NOT NULL 


cl col UNIQUEIDENTIFIER NOT NULL DEFAULT(NEWID()), 


filler CHARC2000) NOT NULL DEFAULT('a') 


) 
CREATE UNIQUE CLUSTERED INDEX idx cl col ON dbo.T1(cl coU; 


GO 
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LISTING 2: First Test, Code to Run in 
Connection | 


-- Connection 1: insert rows 
SET NOCOUNT ON; 

USE testdb; 

GO 

TRUNCATE TABLE dbo.T1; 


WHILE 1 = 1 
INSERT INTO dbo.T1 DEFAULT VALUES; 
GO 


LISTING 3: First Test, Code to Run in 
Connection 2 


-- Connection 2: read 
SET NOCOUNT ON; 

USE testdb; 

GO 


WHILE 1 = 1 
BEGIN 
SELECT * INTO #T1 FROM dbo.T1 WITH(NOLOCKO; 


IF EXISTS( 
SELECT cl col 
FROM #T1 
GROUP BY cl, col 
HAVING COUNT(*) > 1) BREAK; 


DROP TABLE #11; 
ND 


SELECT cl, col, COUNT(*) AS cnt 
FROM ZT1 

GROUP BY cl, col 

HAVING COUNT(*) » 1; 


DROP TABLE #11; 
GO 


LISTING 4: Creating Tables Tl and 
Sequence 


SET NOCOUNT ON; 

USE testdb; 

GO 

-- Create table T1 

TEROBJECT=IDGtdbo lini, 
DROP TABLE dbo.T1; 

GO 

CREATE TABLE dbo.T1 

& 


'U') IS NOT NULL 


cl, col UNIQUEIDENTIFIER NOT NULL 
DEFAULTC(NEWID()), 
seq val INT NOT NULL, 
filler CHAR(2000) NOT NULL DEFAULT('a') 
2; 
CREATE UNIQUE CLUSTERED INDEX idx cl col ON 
dbo.T1Ccl, coL); 
GO 


-- Create table Sequence 

IF OBJECT. ID('dbo.Sequence', 
DROP TABLE dbo.Sequence; 

GO 

CREATE TABLE dbo.Sequence(val INT NOT NULL); 

INSERT INTO dbo.Sequence(val) VALUES(COD ; 

GO 


'U') IS NOT NULL 


LISTING 5: Second Test, Code to Run 
in Connection | 


-- Connection 1: insert rows 
SET NOCOUNT ON; 

USE testdb; 

GO 


UPDATE dbo.Sequence SET val - 0; 
TRUNCATE TABLE dbo.T1; 


DECLARE @nextval AS INT; 


WHILE 1 = 1 
BEGIN 
UPDATE dbo.Sequence SET @nextval = val = val + 1; 
INSERT INTO dbo.T1(seq_val) VALUES(@nextval); 
END 


INTO statement runs with the NOLOCK hint and will 
show up in the plan as an index scan with the Ordered: 
False property. Namely, the storage engine might use an 
allocation-order scan in this case. Once the IF EXISTS 
statement finds missing sequence values, the code returns 
the pairs of adjacent sequence values with a gap between 
them, proving that the scan skipped sequence values in the 
table. Table 2 shows sample output I got in connection 2 
after a few seconds. Once you get output from connection 
2, you can stop the code running in connection 1. 


On Performance of Index Scans 
Allocation-order scans are virtually always preferable to 
index-order scans in terms of performance. However, read 
consistency might very well be higher in priority. With zero 
logical fragmentation of an index, both should perform 
similarly; however, with high levels of fragmentation, 
index-order scans can get much slower. I discussed the 
cases in which the storage engine uses unsafe allocation- 
order scans. There are cases, however, when the storage 
engine can utilize the faster allocation-order scans when 
the plan shows Clustered Index Scan or Index Scan with 
Ordered: False without sacrificing read consistency: 

* TABLOCK—When you query data with the TABLOCK 
hint, no one can insert data while you read. The storage 
engine can safely use an allocation-order scan in this 
case. Of course, you have to consider the implications on 
processes trying to modify the table data while you read. 
READ_ONLY—When the index being scanned resides 
in a READ ONLY file group or database, again, since 
the storage engine realizes that no one can modify data 
during the read, it can safely use an allocation-order 
scan. This is something that you have control over. If you 
have tables that are modified periodically, you can place 
them in a READ ONLY file group and temporarily 
set the file group to READ. WRITE allow the periodic 
modifications. This way, you'll get the faster alloca- 
tion-order scans. Similarly, a database holding a data 
warehouse or data mart can be set to READ ONLY 
during the day and changed to READ WRITE tempo- 
rarily during the Extract, Transform, and Load (ETL) 
processes loading the daily data. 


A Read Uncommitted/NOLOCK 
Alternative 

A common Read Uncommitted scenario involves systems 
that need to support very frequent inserts, and readers 
keep getting blocked when trying to acquire shared 
locks. And if readers manage to obtain shared locks, 
they interfere with writers. You might have thought that 
individual inserts—each run as an independent transac- 
tion—wouldn’t cause consistency problems under Read 
Uncommitted, but now you know the truth. So, is your 
environment doomed to either suffer from the read-consis- 
tency problems described in this article or suffer from fre- 
quent blocking problems and slow running index scans? 
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There might be a reasonable alternative in SQL Server 2005 using 
the Read Committed Snapshot isolation. This isolation is similar in 
concept to Read Committed, except that it’s based on row versioning 
and not shared locks for readers. If your environment mainly has 
frequent reads and inserts with infrequent updates and deletes, it 
might be a good candidate for Read Committed Snapshot. Deletes 
and updates get versioned, but inserts don’t, so in such a system there 
will be little overhead on the version store in the tempdb database. 
The storage engine will utilize index order scans for clustered index 
scans and index scans with the Ordered: False property, so you won't 
face the consistency problems that this series of articles describes. You 
can mitigate the performance problems with such scans by keeping 
your indexes defragmented, and when you rebuild indexes as part of 
your maintenance process, you can specify a fill factor to reduce the 
occurrences of splits. In this isolation, readers won't get blocked by 
writers, and writers won't get blocked by readers. This is an option 
that's definitely worthwhile to test in your system as an alternative to 
Read Uncommitted. 


TABLE |: First Test, Output of 
Connection 2 


cl col cnt 
9958564C-91B2-4B81-8623-CECB8C060B93 2 
T8BBFE14-9D5B-46C2-A666-CF1095B705D8 2 


TABLE 2: Second Test, 
Output of Connection 2 


Xur nxt 
1198 1200 
1236 1238 


LISTING 6: Second Test, Code to Run 
in Connection 2 


-- Connection 2: read 
SET NOCOUNT ON; 
USE testdb; 


GO 

DECLARE @max AS INT; 
WHILE 1 = 1 

BEGIN 


SET @max = (SELECT MAX (seq_val) FROM dbo.T1); 
SELECT * INTO #T1 FROM dbo.T1 WITH(NOLOCKO; 
CREATE NONCLUSTERED INDEX idx seq val ON ZT1(seq val); 


IF EXISTS( 
SELECT 
FROM (SELECT seq val AS cur, 
(SELECT MIN(Cseq val) 
FROM ZT1 AS N 
WHERE N.seq val » C.seq val) AS nxt 
FROM #T1 AS C) AS D 
WHERE nxt - cur > 1) 
AND cur < àmax) BREAK; 
DROP TABLE #T1; 
END 


SEIBECTES 
FROM CSELECT seq val AS cur, 
(SELECT MIN(Cseq val) 
FROM #T1 AS N 
WHERE N.seq val » C.seq val) AS nxt 
FROM #T1 AS C) AS D 
WHERE nxt - cur > 1 
AND cur < @max; 
DROP TABLE #T1; 
GO 
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On to the Next Step 

You now know about read-consistency problems that can occur when reading 

data under the Read Uncommitted isolation when processes insert data while 

an allocation order scan of an index is in progress. Next month, [Il describe 

other read-consistency problems that can happen even with index order scans 

in both Read Uncommitted and Read Committed isolations. En 
InstantDoc ID 97456 


THE LOGICAL PUZZLE 


Solution to December's Puzzle: Minimum Number 
of Weights 

Can you determine the minimum number of weights required to measure 
any integer weight in the range 1 through 100 pounds using a scale? 
Also, can you generalize your answer for a range 1 through n pounds? 


The puzzle doesn't restrict you to placing the item you're weighing 
on one side of the scale and the weights on the other. Therefore, you 
can place weights on both sides. Weights that you place on the same 
side of the scale as the item you're weighing will have negative values, 
whereas weights that you place on the other side will have positive 
values. To simplify the solution's explanation, first assume that there 
was a restriction to place the item you're weighing on one side of the 
scale and the weights on the other. 

Given a set of weights, to measure some item's weight (call it w), 
you need to use a subset of the weights you have—that is, each weight 
from your set of weights will either be used or not used to weigh the 
item. So any w in the range 1 through n can be represented with a 
bitmap, where each bit represents a different weight from your set of 
weights, and only the bits of the participating weights will be turned 
on. A binary representation will give you the least number of weights 
required to weigh any item in the range 1 through n. For example, to 
represent any integer in the range 1 through 100, you need 7 bits (1, 
2, 4, 8, 16, 32, and 64). Notice that you get a geometric sequence 
(also known as a geometric progression) with a common ratio 2 (1x29, 
1x2!, 1x2?, 1x25, etc.). To represent any integer in the range 1 
through n, the geometric series (i.e., the sum of the numbers in the 
geometric sequence) must be greater than or equal to n. The simplified 
formula for the sum of the geometric sequence in our case is 2numweiehis - 1, 
and this sum must be greater than or equal to n. Hence, the minimum 
number of weights required is ceiling(log2(n+1)). 

Next, remove the restriction to place weights only on one side of 
the scale. Now each weight from your set of weights can assume one 
of three roles: first, placed on the same side of the scale as the item 
you're weighing (i.e., a negative value); second, placed on the other 
side of the scale (i.e., a positive value); and third, not used (i.e., a O 
value). So, just as you used a string of binary digits in base 2 to repre- 
sent the set of utilized weights to solve the puzzle with the restriction, 
you can use a string of digits in base 3 to represent the set of utilized 
weights to solve the puzzle without the restriction. To represent any 
integer in the range 1 through 100, you need five digits 
that are powers of 3 (1, 3, 9, 27, and 81). Each can 
be used as a positive value, negative value, or not 
used. This time, the common ratio of our geometric 
sequence is 3. The simplified sum of the geometric 
sequence is (3™™welhts - 1) + 2. To represent any in- 
teger in the range 1 through n, the minimum num- 
ber of weights required is ceiling(log3(2xn+1)). 


January's Puzzle: Counting Triangles 
Can you figure out how many triangles Figure 
A contains? Can you think of a methodical 
approach or formula to calculate this number? 
InstantDoc 1D 97457 Figure A: Counting 
— — triangles 
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Examining 


XML Plans... 


Use SQL Server 20055 sys.dm. exec. cached - 
plans dynamic management view to probe 
details of your users query plans 


you learned last month in “Managing 
A S Plan-Cache Size,” InstantDoc ID 97373, 

SQL Server 2005 provides some controls 
to keep plan cache from getting too large. In addition to 
the techniques I discussed that you can use to help control 
plan-cache size, you can also use metadata that's available 
in SQL Server 2005 to see the actual plans stored in the 
plan cache. There are about a dozen different dynamic 
management views and functions that offer information 
about plan-cache contents, and those don't include the 
metadata that provides information about memory usage 
by plan cache. The core dynamic management view that 
gives information about plan-cache contents is called 
sys.dm exec cached plans, and we'll examine that view 
in detail and how you can use it to view an XML plan 
in plan cache. By viewing cache metadata, you can see 
any query plan that's in cache without having to run the 
query yourself, and you can also compare many plans at 
the same time. 


Using sys.dm exec cached plans 
In SQL Server 2000, the only information available about 
the contents of plan 
ORE on the WEB cache is through a 
Download the listings at pseudo-table called 
InstantDoc ID 97562. syscacheobjects. 
This view is still 
available in SQL Server 2005 as the sys.syscacheobjects 
view. You can look at SQL Server 2005's definition of sys 
.syscacheobjects by using the OBJECT DEFINITION 
function, and you'll see that the basis of this view is the 
dynamic management view sys.dm exec cached plans. 

Here's the code to do this: 


SELECT object, definition 
Cobject, id ('sys.syscacheobjects')) 


(Some code in this article wraps to multiple lines to fit on 
the printed page.) Observe the object definition returned 
and notice that the FROM clause contains a derived table 
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that uses an OUTER APPLY operator to combine sys 
‚dm exec cached plans with the sys.dm exec plan . 
attributes function. Think of the OUTER APPLY 
operator as if it's joining a view or table with a table- 
valued function and applying the function to each row 
in the table or view. This OUTER APPLY allows sys 
„syscacheobjects to display many attributes for each 
plan, including the set options bit string and the dbid, 
language id, and date format values. Another OUTER 
APPLY is then used to "join" this derived table with the 
sys.dm exec sql text function, using the plan handleasa 
parameter, to retrieve the text of the query that generated 
each of the plans. 

The richness of the content of sys.dm exec cached _ 
plans lets you pick and choose exactly what plan-cache 
information you want to see. [Il use the sys.dm exec - 
cached plans view and combine it with the sys.dm exec _ 
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B i EXAMINING XML PLANS IN CACHE 


TABLE |: Sample Output of Code in Listing | 


at plans of type prepared. 
However, compiled plans 
come in three varieties: ad 
hoc, prepared, and proc. 
I discussed these three 
types of plans back in Sep- 
tember 1999 in “Inside SQL 
Server: SQL Server 7.0 Plan 
Caching,” InstantDoc ID 
5915, which focused on 


usecounts cacheobjtype objtype text 
1 Compiled plan Ad hoc SELECT * 
FROM Sales.SalesOrderHeader 
WHERE SalesOrderlD = 71056; 
1 Compiled plan Ad hoc SELECT * 
FROM Sales.SalesOrderHeader 
WHERE SalesOrderlD = 43665; 
2 Compiled plan Prepared (Q1 int)SELECT * 


FROM [Sales].[SalesOrderHeader] 
WHERE [SalesOrderlD]- 1 


sql. text function as sys.syscacheobjects does. Additionally, 
TIl combine the sys.dm exec cached plans view with the 
sys.dm exec query. plan function, which returns, among 
a few other columns, the corresponding query plan in 
XML format. I discuss XML query plans in “The XML 
Query-Plan Treasure Trove,’ May 2007, InstantDoc ID 
95498, but there I focus on the plans retrieved using SET 
SHOWPLAN XML ON and SET STATISTICS XML 
ON. Those options are fine when you want to examine 
only one plan at a time, but when you want to examine one 


<ShowPlanXML xmlnsz"http://schemas.microsoft.com/sqlserver/2004/07/showplan" 
Version="1.0" Build="9.00.3054.00"> 
<BatchSequence> 
<Batch> 
<Statements> 
<StmtSimple StatementText="SELECT 
Sales.SalesOrderHeader&#xD;&#xA;WHERE SalesOrderID 


* FROM 


71056;&HxD;&HxA;" StatementId-"1" StatementCompId-"1" 


StatementType="SELECT" /> 
</Statements> 
</Batch> 
</BatchSequence> 
</ShowPlanXML> 


Figure | particular plan among many that have already been cached, 


you need to be able to examine plan cache directly. 

The code in Listing 1 returns all the compiled plans 
from your plan cache except for those that are examining 
the dynamic management objects. In other words, I'm not 
interested in seeing the plans for the queries I’m using to 
see the plans. 

In “Controlling Parameterization,’ August 2007, 
InstantDoc ID 96349, I examined sys.syscacheobjects to 
see the effect of autoparameterization and looked only 


Truncated version 
of XML query plan 


LISTING |: Returning All Compiled 
Plans from Plan Cache 


SELECT usecounts, cacheobjtype, 
objtype, [text], query, plan 
FROM sys.dm exec, cached plans P 
CROSS APPLY 
sys.dm exec sql, text(plan handle) 
CROSS APPLY 
sys.dm exec query plan(plan handle) 
WHERE cacheobjtype = 'Compiled Plan' 
AND [text] NOT LIKE 'Zsys.dm_%'; 
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SQL Server 7.0, but almost 
everything I said in that 
article about the differences 
between the three types of 
plans is still valid in SQL 
Server 2005 and 2000. In 
SQL Server 2005, a plan that's autoparameterized by SQL 
Server will actually have two rows in the plan cache, both 
a row for an ad hoc plan and one for a prepared plan. 
However, the rows for the ad hoc plans are considered shell 
queries and are cached only to make it easier to find the 
autoparameterized version of the query if the exact same 
query with the same constant is reused later. 


Viewing an XML Plan 

in Plan Cache 

To see an example of the two types of plans 
cached for autoparameterized queries, run the 
code in Listing 2. This code first clears the plan 
cache, then runs two similar queries, which vary 
only by the constant used in the WHERE clause. 
Because there is a unique index on the column in 
the WHERE clause, the plan is considered safe 
(i.e., there's only one possible plan) and is autopa- 
rameterized. Running the code in Listing 1 should 
now give you output with the first four columns 
similar to that which Table 1 shows. 

You should notice two individual queries with distinct 
constants, which are cached as ad hoc queries. These are 
only the shell queries mentioned earlier. These shell queries 
don’t contain the full execution plan but only a pointer to 
the full plan in the corresponding prepared plan. The third 
row in Table | has an objtype of prepared. The full query 
plan is associated with the prepared plan, and you can 
observe that the plan was used twice. In addition, the text 
now shows a parameter in place of a constant. 

Table | shows only the first four columns of the output 
of my query in Listing 1. There is actually a fifth column 
that isn’t in the table because the column is too wide. This 
column is the XML query plan returned by the function 
sys.dm_exec_query_plan. If you're displaying your results 
in “grid” mode in SQL Server Management Studio, the 
XML plan is shown as a link, and you can click the link 
to display a separate window containing the XML docu- 
ment. If you click the link for either ad hoc plan, you'll 
get only a truncated query plan, something like that in 


SQL Server Magazine * www.sqlmag.com 


EXAMINING XML PLANS IN CACHE 


Figure 1. The full XML plan, showing all the columns 
returned at each step and the constant value that the plan 
was compiled with, is about 276 lines long and is returned 
in the XML for the prepared plan. 

In this case, the two ad hoc plans have a corresponding 
prepared plan containing the full XML plan. However, 
there are cases in which you'll have an ad hoc plan for 
which the full XML isn't available at all in cache. To see 
an example of such as case, run the code in Listing 3, 
which clears the plan cache again and runs a query that 
isn't considered “safe.” There is a nonunique, nonclustered 
index on CustomerID, and some CustomerID values 
might occur much more often than others. For this reason, 
SQL Server's optimizer cannot be sure that the plan it 
generates for one specific value of CustomerID will still 
be the best plan for another specific value of CustomerID. 
No autoparameterization is done, and if you run the code 


A plan that's auto- 
parameterized by SQL 
Server will have two rows in 
the plan cache, both a row 
for an ad hoc plan and one 
for a prepared plan. 


in Listing 1 again, the output will show only an ad hoc 
plan. Clicking the link of the XML plan shows only the 
truncated plan. The only way to see the full XML plan 
for this query is to turn on either SHOWPLAN XML 
or STATISTICS XML prior to running the query, then 
look for the plan in the results window. The plan won't be 
available in sys.dm exec cached plans. 


Truncated Plans 

Not all non-parameterized queries provide only the 

truncated plan in cache. When I first started exploring 

the plan-cache metadata, I was very frustrated because 

sometimes I'd see the full XML for the ad hoc plan, and 

sometimes I wouldn't. Just recently, I realized what the 

difference was. There are two main reasons that SQL 

Server won't autoparameterize a query. As I mentioned 

earlier, queries won't be autoparameterized if the opti- 

mizer doesn't consider them safe. In addition, even if 

there's only one possible plan for a query, if the query 

contains any of a list of particular query constructs, the 

query won't be autoparameterized by default. “Control- 

ling Parameterization" contains a list of these constructs; 

following is a partial list: 

* [N clauses 

* SELECT statement with INTO clause 

* SELECT statement whose SELECT list contains a 
DISTINCT 

* statement with the TOP clause 
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* when a SELECT query contains a subquery or JOIN 

* when a SELECT statement has GROUP BY, 
HAVING, or COMPUTE BY 

* expressions joined by OR in a WHERE clause 


If your query contains any of these elements, it will not 
be autoparameterized unless you've set your database to 
FORCED parameterization or you have a plan guide that 
uses a PARAMETERIZATION FORCED hint, which I 


describe in “Controlling Parameterization.” 
Listing 4 contains three very simple queries, but each 


one contains a construct in 
the previous list. The first 
query combines the two 
autoparameterized queries 
from Listing 2, but com- 
bines the two constants in an 
IN clause. The second query 
performs a straightforward 
JOIN that returns only one 


LISTING 2: Viewing 2 Plans Cached for 
Autoparameterized Queries 


USE AdventureWorks; 


GO 

DBCC FREEPROCCACHE; 

GO 

SELECT * FROM Sales.SalesOrderHeader 
WHERE SalesOrderID - 43665; 

GO 

SELECT * FROM Sales.SalesOrderHeader 
WHERE SalesOrderID - 71056; 

GO 


row. The third query aggre- 

gates the data in the Sales 

„SalesOrderDetail table using a GROUP BY. Running the 
code in Listing 1 after running the code in Listing 4 should 
show three ad hoc plans. However, unlike the query plan 
from the ad hoc query in Listing 3, clicking the XML plan 
links for the queries in Listing 4 should show the full XML 
query plans for each of the three queries. 

Ad hoc plans in cache will result in a truncated XML 
plan if there's a corresponding prepared plan, or if the 
plan is a simple one and considered unsafe for autoparam- 
eterization. Ad hoc plans that can't be autoparameterized 
because they use one of the disallowed constructs will 
provide the full XML plan in cache. 


Keeping an Eye on Query Plans 
One of the benefits of using the plan cache metadata is to 
allow you to see plans for queries that have been run by any 
user, as long as the plan is 
still cached. You don't need 
to run the query yourself 
and include the SET options 
to return the plan. In addi- 
tion, having the plan cache 
metadata available allows 
you to compare many plans 
at the same time. In my 
next article, I'll continue to SELECT * FROM Sales.Sa 

: WHERE SalesOrderID in ( 
examine plan cache and GO 

; SELECT * 
show you some of the avail- FROM Sales.SalesOrder 
able metadata to find que- JOIN Sales.SalesOrd 
. ON sh.SalesOrderID - 
ries that are run often and WHERE sh.SalesOrderID = 
queries that take the greatest A Sele corderpei aili 
1 SELECT SalesOrderID, co 
amount of resources during FROM Sales.SalesOrderDe 
execution. SOL} GROUP BY SalesOrderID; 
InstantDoc ID 97562 


DBCC FREEPROCCACHE; 
SELECT * FROM Sales.Sal 
WHERE CustomerID - 


LISTING 4: Queries 


DBCC FREEPROCCACHE; 
G 


GO 


LISTING 3: Sample “Unsafe” Query 


esOrderHeader 
ae 


Using Constructs 


That Preclude Autoparameterization 


lesOrderDetail 
43665, 71056); 


Header sh 
erDetail sd 
sd.SalesOrderID 
43663 

D =-523 


unt(*) 
tail 


January 2008 35 


FEATURE 


Omri Bahat 
(omri@sqlfarms.com) is a director at SQL Farms 


in Reston, Virginia. Specializing in scale-out data- 
base architectures, he served as the lead database 


architect at Symantec and has a doctorate in 


electrical and computer engineering. 


36 January 2008 


Download the listings at 
InstantDoc ID 97018. 


MOVING 


ie D 


TABLES: ET 


+ 


FILEGROUPS: 


ap N 


r Y 


JA Better Way 


Use this nifty script to move tables and 
indexed views between filegroups efficiently 


and automatically 


base's location and size because they let DBAs 

easily move files between different disks or net- 
work computers. But using filegroups can present prob- 
lems when you need to move tables because if you define 
multiple filegroups for a single database, then some tables 
can reside in one filegroup while other tables might be 
stored in a different filegroup. If you then need to move 
data files, the fact that the data is spread out among file- 
groups means you'll likely have to move tables from one 
filegroup to another. Here's a sample scenario: A database 
called [MyDB] has two filegroups, which the sample code 
in Listing 1 shows. The first filegroup, called [PRIMARY], 
contains the data file C:\MyDB_Primary.mdf; the second 
filegroup, [MyFileGroup], has the data file D:\MyDB_ 
MyFilegroup.ndf. If I want to move all the table data to 
drive D while maintaining 100 percent uptime (in which 
case detaching databases or taking files offline is not an 
acceptable option), then I must move tables from one 
filegroup to the other. The need to move tables arises 
in other situations, such as in filegroup consolidation 
or before deleting database files. To make moving tables 
between filegroups easier and more efficient, I’ve written 

a SQL script that moves one table between 


[E ilegroups are useful tools for controlling a data- 


ORE on the WEB filegroups. The script doesn't assume any prior 


knowledge about the table and can be used to 
move tables that have a clustered index and also 
to move heaps. In addition, the script lets users 
specify whether a table's nonclustered indexes and unique 
constraints should be moved as well. 

My script is useful for moving tables or indexed views 
for SQL Server 2005 and SQL Server 2000. If a table 
you want to move has full-text indexes, the script won't 
register those indexes with the full text catalog, nor will 
the script move user-defined statistics. Note that although 
Icomposed the script to move single tables, you can easily 
modify it to move a collection of tables and indexed views. 
Before I explain how my script works, let's take a look at 
the basics of tables and moving them between filegroups. 


(The description following applies as well to indexed 
views because indexes on views have the same underlying 
architecture that table indexes do.) 


Understanding Table Types 

A table is stored on the filegroup that holds its data pages. 
In order to move a table between filegroups and keep the 
table schema intact, it's important to distinguish between 
two types of tables. The first table type refers to tables 
that have a clustered index. When a table has a clustered 
index, the data pages are the leaf pages of the clustered 
index B-tree. To move such tables, you must recreate the 
clustered index on the target filegroup and also move the 
nonclustered indexes and constraints. The second table 
type refers to heaps. With tables that don't have a clus- 
tered index, you can move the data pages by dropping the 
table, then recreating it on the desired file group. A better 
solution that omits the need to drop the table creates a 
clustered index on the target filegroup, then drops the 
clustered index later. 


LISTING |: Sample Code to Create a 
Database with Multiple Filegroups 


USE master 
GO 


-- Creating a database with multiple filegroups 
IF DB ID('MyDB') IS NOT NULL 

DROP DATABASE MyDB 
GO 


CREATE DATABASE LMyDBl 
ON PRIMARY € 

NAME = 'MyDB', 

FILENAME = N'C:\MyDB_Primary.mdf'), 
FILEGROUP MyFileGroup € 

NAME = 'MyDBFileGroup2', 

FILENAME = N'D:\MyDB_MyFilegroup.ndf') 


GO 

-- Verifying file info 
USE MyDB 

GO 

=-= Option I: 

EXEC sp_helpfile 

== Option II: 

SELECT * FROM sysfiles 
GO 
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[9 
» 


LISTING 2: Sample Code Containing 
the Data Definition Language (DDL) 
for the Table 


IF OBJECT ID(C'Ldbol.LutbMyTable11') IS NOT NULL 
DROP TABLE [dbol.LutbMyTable11 


Although it might seem from the foregoing explana- go 


tion that tables can be moved easily, keep in mind that 
changing clustered indexes can negatively affect a server’s 


controlled by the user. 
Another simple and 
popular way to move tables 


CREATE TABLE Ldbol.LutbMyTable11 
(ECol1, 11 INT IDENTITY(1, 1), 
[Col1. 21 NVARCHAR(10), 
[Col1_3] BIGINT, 


performance and thus the availability of data, especially 
in large tables. When it comes to moving tables, the devil 
truly is in the details. 


Existing Table-Moving Techniques 
Assume that the database [MyDB] contains the table 
[dbo].[MyTablel] This table has a primary key that is 
also a clustered index, a nonclustered index, and a unique 
constraint (the Data Definition Language—DDL—for 
the table is provided in the sample code in Listing 2). The 
indexes and constraints for this table all reside on the 
[PRIMARY] filegroup—we can validate this by running 
the SQL code in Listing 3 against the [MyDB] database. 
This SQL statement returns the filegroup information 
for all indexes and constraints that belong to the table 
[dbo].[ MyTablel]. 

One technique for moving a table to a different filegroup 
is to use Enterprise Manager in SQL Server 2005 or SQL 
Server 2000. In Enterprise Manager you can right-click the 
table, select Design Table, click the Properties icon, then 
select the desired filegroup from the Table Filegroup drop- 
down menu, as Figure 1, page 38, shows. To move the table’s 
indexes and constraints, you can go to the Indexes/Keys tab 
on the Properties page, as Figure 2, page 38, shows, change 
the filegroup for each object in the Index Filegroup drop- 
down menu, click Close, then click Yes when prompted to 
apply the changes. Unfortunately, the ability to move a table 
to a different filegroup from the UI is no longer available in 
SQL Server Management Studio. 

This technique's main benefit is that it's straightfor- 
ward. However, a quick look under the hood reveals that it 
isn't particularly efficient: Moving several tables requires a 
lot of tedious and manual work. Moreover, if you were to 
run SQL Profiler during the table move, you'd see that the 
GUI creates a new table called [dbo].[Tmp utbMyTablel], 
moves the data from [dbo].[utbMyTablel] to the new 
table, then makes the new table assume the identity of the 
original one. These actions are inefficient because the table 
data is duplicated and stored twice in the database (once 
in [dbo].[utbMyTable1] and once in [dbo].[Tmp utbMy- 
Tablel], which is extremely wasteful, especially in the 
case of large tables. Another problem with this method 
is that if the table [dbo].[utbMyTablel] has user-defined 
statistics, those statistics are dropped without warning and 
are not recreated. These actions are embedded in Enter- 
prise Manager and in the SQL Distributed Management 
Objects (DMO)—both for SQL Server 2000 and the SQL 
Server 2005-compatible DMO—and therefore can't be 
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with a clustered index is to 
recreate the clustered index 
usingthe CREATEINDEX 
command together with 
the DROP EXISTING 
clause, as the sample code 
in Listing 4, page 38, illus- 

trates. This method is quick a CERIMARYI 
and easy; however, it results 
in redundant and wasteful 
operations. The SQL state- 
ment in Listing 4 moves 
only the clustered index 
and therefore has to be followed by similar statements 
for all nonclustered indexes. The recreation of the clus- 
tered index forces a rebuild of all nonclustered indexes 
and B-trees because the leaf pages of the nonclustered 
indexes must be redirected to point to the leaf pages of 
the newly reconstructed clustered index. In other words, 
using this technique rebuilds the nonclustered indexes 
twice—once when the clustered index is moved and again 
when the nonclustered indexes are recreated on the target 
filegroup. 


[Col1 41 IMAGE) 
ON CPRIMARY] 
G0 


GO 


UNIQUE(CECoL1, 51) 
ON [PRIMARY] 
GO 


A More Efficient Solution 

As I’ve mentioned, the script I've written can move any 
type of table, including heaps. Here's how it operates. The 
script accepts five user-assigned parameters: The variables 
@SourceFileGroupID and @TargetFileGroupID are set 
by the user and hold the original filegroup ID for the table 
to be moved, as well as the ID of the target filegroup. You 
can obtain the IDs of the database file groups by running 
EXEC sp_helpfile or by querying the system object [sys- 
files]. Before running the script, you should also specify the 
name of the table to move as the variable @TableToMove. 
Moreover, you can indicate whether the primary key and 
constraints should also be moved by setting the value of 
the bit variable @MovePK AndAllUniqueConstraints to 
1. In the same way, the bit 
variable @MoveAllNon- 
ClusteredIndexes indicates 
whether to move the non- 
clustered indexes. 

In order to move the 
table, the script performs the 
following steps and actions. 
First, the script determines 
whether the source and 


Constraints 


FROM sysindexes a 


'IsAutoStatistics') 


ALTER TABLE Edbol.LutbMyTable11 
ADD CONSTRAINT CPK_utbMyTable1] 
PRIMARY KEY CLUSTERED (LCol1 11) 


CREATE INDEX IX utbMyTable!, Col1 2 
ON Ldbol.LutbMyTable11(LCol1, 21) 


ALTER TABLE Edbol.LutbMyTable11 
ADD CONSTRAINT LUG utbMyTable1 Col! 351 


When it 
comes to 
moving 
tables, the 
devil truly 
is in the 
details. 


LISTING 3: Sample Code to Return 
Filegroup Information for Indexes and 


SELECT a.indid, a.groupid, a.name, b.groupname 


INNER JOIN sysfilegroups b 
ON a.groupid = b.groupid 

WHERE a.id = OBJECT ID('Edbol.LutbMyTable11') 
AND INDEXPROPERTY(a.id, a.name, 
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Properties 


Tables | Relationships | Indexes/Keys | Check Constraints | 


Selected table: futbMyTablet + | 
Owner: lin dbo E | 
Table name: [utbMyTable1 

Table Identity Column: [cott 1 -l 


Table ROWGUID Column: | E 
[PRIMARY v | 


MyFileGroup 


Table Filegroup: 


Text Filegroup: 


PRIMARY 


Description: 


Figure | 


Changing filegroups in 
Enterprise Manager 


Properties 


Tables | Relationships Indexes/Keys | Check Constraints | 


Table name: 
Selected index: 
Type: 


Index name: 


Index Filegroup: 


Constraint 


C index 


target filegroups and the requested table indeed exist, and 
aborts if they do not. Then, the script checks whether the 
requested table has a clustered index or is a heap. If the 
table is a heap, the script determines whether the table 
contains a unique column (i.e., an identity column or a 
column with a primary key or unique constraint). If a 
unique column indeed exists, the script creates a non- 
unique clustered index on that column on the appropriate 
target filegroup. 
Applying the clus- 
tered index on a 
unique column is 


| utbMyTablei 


useful because the 


T Create UNIQUE 
E 


fix _utbMyTable1_Col1_2 z] 


f Index 


——— 


Column name order | 


» | Ascending 


| MyFileGroup v | 


MyFileGroup 


PRIMARY 


Ignored 


column data has 
high cardinality 
even if duplicate 
data entries exist 
(e.g., as in the 
case of manually 
populating an 
identity column 
with SET IDEN- 
TITY INSERT), 
which guarantees 
fast and efficient 
creation of the 


Index e| | Delete | 


uplical 


te key 


Ef Bad Inde» 


[ Create as CLUSTERED 


I Do not automatically recompute statistics 


clustered index. In 
the event that no 
unique columns 


Figure 2 


Moving a table’s indexes 
and constraints in 
Enterprise Manager 
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are available, the 

script adds a new 

identity column and builds a clustered index on it. All 

items that are added to the table as part of the move 

process are later dropped to ensure that the table schema 
remains unchanged. 

In a case where the requested table has a unique clus- 

tered index, the script will first drop all foreign keys that 

reference the unique index. (If the clustered index is not 


unique, then there's no need to drop foreign keys.) Next, 
the clustered index is dropped. If you instruct the script to 
move the nonclustered indexes and the table constraints, 
they will be dropped to avoid the duplicate index rebuild 
I described previously Finally, the script creates the 
clustered index on the target filegroup and also recreates 
all the indexes, constraints, and keys that were dropped 
earlier while maintaining all properties and attributes for 
all objects (such as PADINDEX and FILLFACTOR). 


Moving IMAGE and TEXT 
Columns to Other Filegroups in 
SQL Server 2000 

In SQL Server 2000 we have the option to explicitly specify 
the filegroup for columns that use long data types (i.e., 
IMAGE, TEXT, NTEXT) by using the TEXTIMAGE 
ON clause. For example, we can change the table creation 
statement in Listing 1 to write: 


CREATE TABLE CdboJ.CutbMyTable1] 
(ECol11 INT IDENTITY(1, 1), 
CCol2] NVARCHAR(10), 
CCol3] BIGINT, 
LCol4] IMAGE) 

ON [PRIMARY] 

TEXTIMAGE ON CMyFilegroup] 


in which case the IMAGE data stored in column Col4 
would reside on the filegroup [MyFilegroup]. If a table 
has more than one column that utilizes a large data type, 
then the data for all such large columns will be stored 
on the filegroup specified in the TEXTIMAGE ON 
section. In SQL Server 2005 the TEXTIMAGE ON 
clause is no longer available—the data contained in 
IMAGE, XML, TEXT, NTEXT, VARBINARY(MAX), 
VARCHAR(MAX), and NVARCHAR(MAX) columns 
always resides on the same filegroup as the table's data 
pages. It's important to note that my script doesn't move 
data for the column types specified above because the 
only way to move these data entries is by dropping and 
recreating the entire table. 


Limitations and Possibilities 
My script doesn't handle the case in which two objects in 
the database have the same name and belong to different 
schemas. On top, the script handles one table or indexed 
view at a time. I encourage interested readers to tune the 
script to move multiple objects and handle richer scenarios 
to fit their database environments. Er 
InstantDoc ID 97018 


LISTING 4: Sample Code to Create a 
Unique Clustered Index 


CREATE UNIQUE CLUSTERED INDEX CPK_utbMyTable1] 
ON Edbol.LutbMyTable11 ([Col1_11) 

WITH DROP_EXISTING 

ON CMyFilegroup] 

GO 
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A SQL Server 2005 


Cleans Up 
Your Indexes 


Get sys.dm db index usage stats up and running 
in your environment 


ow many times has someone asked you, *How 

do I go about cleaning up all these unused 

indexes?" If you're like most DBAs, you've 
often fielded this question or even pondered it yourself. In 
SQL Server 2000, cleaning up unused indexes is an almost 
impossible task that requires many hours of investigation 
and a solid knowledge of the workings of each and every 
table in your databases. SQL Server 2005 gives us some 
salvation and eases the burden dramatically with the addi- 
tion of a Dynamic Management View (DMV) that suits 
this task perfectly—that is, the sys.dm. db index usage _ 
stats DMV. Let's take a brief look at this DMV and put it 
to work in your environment. 


DMV Basics 

Most of the columns that this DMV returns are self- 

explanatory, so I won't go into the details of all of them. 

The columns are essentially broken down into two catego- 

ries to individually track user and system access for each 

index on each table. The DMV also tracks access to the 
table itself through index 1d 0 (if it's a heap) or index 1d 

1 (if it has a clustered index). Oddly enough, the system 

statistics are generated when the indexes are accessed as a 

result of internal or system-level operations. These may 

consist of (but aren't limited to) operations such as data- 
base consistency checks (DBCCs), index rebuilds, statistics 
updates, and so on. The user statistics are the direct result 
of user activity such as Selects, Inserts, Updates, and 

Deletes. Some of the key statistics captured for each index 

or the heap are as follows: 

* Scans—These occur when the access method never 
attempts to use the index in a typical B-Tree operation 
(e.g., a Seek). In other words, it will read all the pages 
in the order it deems appropriate unless there’s a lim- 
iting clause (e.g., TOP, ROWCOUNT). 

* Seeks— These occur when the B-Tree or index is used 
to fetch one or more rows. This might also include 
range scans that start their process with a Seek. 

* Lookups— These occur when an index or heap is 
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accessed via a non-clustered index to retrieve extra 
columns not present in the non-clustered index to 
satisfy the Select list. These are commonly referred to 
as BookMark Lookup operations. 

* Updates— These occur whenever there's an Insert, 
Update, or Delete (ie, not just Updates). 

* Last xxx— Tracks the date and time of the most recent 
Scan, Seek, Lookup, or Update operation for each of 
the user and system statistics. 


Check It Out 

You can see right away that this DMV offers a host of 
possibilities when it comes to diagnosing index and table 
usage. However, before you jump in, let me point out a few 
important characteristics of this DMV. First, it’s impera- 
tive that you keep in mind the scope of these statistics for 
each database. These statistics are reset to 0 each time the 


LISTING I: Prepping the Database 


-- Take the DB 
USE master; 

GO 

ALTER DATABASE 
GO 

ALTER DATABASE 
GO 

ALTER DATABASE 
GO 

ALTER DATABASE 
GO 

USE AdventureWorks 
GO 


OFF LINE to clear the stats 


AdventureWorks SET OFFLINE; 
AdventureWorks SET ONLINE; 


AdventureWorks SET MULTI, USER; 


-- 1000 rows, Index ID 1 Scan 


SELECT TOP 1000 * FROM CSales].[CSalesOrderHeaderJ 


-- 100 Rows, Index ID 1 Seek 

SELECT * FROM ESalesl.LSalesOrderHeader1 
WHERE CSalesOrderID] BETWEEN 67205 AND 67304 
-- Index ID 2, 1 Row Seek 

SELECT * FROM ESalesl.LSalesOrderHeader1 
WHERE Erowguidl = 
-- 1 Row, Index ID 3 Seek 

SELECT * FROM ESalesl.LSalesOrderHeader1 
WHERE LSalesOrderNumberl] = 'S043693' 
GO 


SELECT * FROM sys.dm db index usage stats 

WHERE Edatabase idl = DB ID('AdventureWorks') 
AND Lobject idl = 
ORDER BY Lindex idl ; 


Andrew J. Kelly 
(AKelly @ SolidQ.com) is a SQL Server MVP 


and the practice manager for performance 
and scalability at Solid Quality Mentors. He 
has 20 years experience with relational 
databases and application development. He 
is a regular speaker at conferences and 


user groups. 


AdventureWorks SET SINGLE_USER WITH ROLLBACK IMMEDIATE; 


'5602C304-853C-43D7-9E79-76E320D476CF' 


OBJECT ID( "[CSales].CSalesOrderHeader1') 
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LISTING 2: Finding Unused Indexes 


Un-used indexes for the current DB 
SELECT OBJECT NAMECi.Lobject id1) AS [Object Namel, 


CASE i.Lindex id1 WHEN Ø THEN N'HEAP' ELSE i.Lnamel END AS [Index Namel, 


i. index id AS [Index ID] 

FROM sys.indexes AS i INNER JOIN sys.objects AS o 

ON i.Lobject id] = o.Lobject idl 

WHERE NOT EXISTS( SELECT * FROM sys.dm db. index usage stats AS u 
WHERE u.Lobject_id] = i.Lobject idl 

AND u.Lindex idl = i.Lindex id] AND [database idl 
AND OBJECTPROPERTY(Ci.Lobject idl,'IsUserTable') = 
ORDER BY [Object Namel, [Index ID] ASC 


= DB_ID()) 
1 


database is closed, the databasde is SET OFFLINE, or the 
SQL Server instance is restarted. As long as you don’t have 
the AutoClose property of the database enabled and you 
haven't manually or programmatically taken the database 
offline, these statistics will reflect the activity in that data- 


CLEAN UP YOUR INDEXES 


Another important factor to consider is that these 
statistics don’t take ROLLBACKs into consideration. If 
you updated a row and rolled back the transaction, the 
associated counters will still be incremented. Triggers that 
manipulate data on the underlying table might skew the 
numbers that you're expecting to see in the DMV. For 
example, an update on a single row might be reflected as 
two updates if the trigger code also updates a row. 

If you run the code in Listing 1, page 39, you should 
see results similar to those in Figure 1 for the user statistics. 
Yes, the figure shows the indexes that are being used, and I 
said I would show you how to find the ones that aren’t being 
used. Simply running the query in Listing 2 will point out all 
indexes and tables that have never been accessed. 


base. Therefore, before you go deleting indexes based on 


these numbers, make sure the database has been up and 
actively running for an extended period of time to ensure 


that you get a good view of the activity. 


Go Further! 
I don’t have room here to fully cover this topic, so—as 
always—be sure to check out the Performance Tuning 


and Optimization forum (sqlforums.windowsitpro.com/ 


2007-10-09 14:38 51.397 2007-10-09 14 
2007-10-09 14:38. 51.490 NULL 
2007-10-09 14:38.51.490 NULL 


object id index id user seeks user scans user lookups user updetes last user seek 
722101613 1 1 1 2 0 
722101613 2 1 0 0 0 
722101613 3 1 0 0 0 


web/forum) for further information. 
There, Pll show you some ways to 
narrow the topic. But this short 
article should get you started on 


last user scsi 


Figure | 


User statistics 


Get Rea 
QL Server 


cleaning up those unwanted indexes. 
En! 
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(78 Virtual Event 
January 24, 20 


Learn how to get more out of SQL Server in this free, virtual event 
on Jan 24, 2008, sponsored by SQL Server Magazine. Discover 
ways to more effectively utilize SQL in your current 2000 or 2005 
environment, while also gaining valuable insight into how SOL 


Server 2008 will affect you. 


In this full-day event, independent experts address SQL Server 


2008 readiness, how to prepare for an upgrade and how to 


Three in-depth tracks! 
Invite your peers! 


prepare for the future evolution of SQL Server. Topics range from 


virtualization to performance tuning, from SSIS to data-centric so- 
lutions. Choose from one of three tracks, depending on your area 
of expertise — administration, business intelligence and developer. 
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http://events.unisfair.com/rt 
sql-jan08 
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SQL Server 


Performance Monitors 


Track and optimize database performance 


A databases become larger and IT infrastructures 
S become more complex, keeping databases 
running at optimal performance is a must in any enter- 
prise. Factor in increasing demands placed on database 
systems for auditing, compliance, and security needs, and 
having a smoothly running database-driven infrastruc- 
ture becomes a significant challenge. How can a DBA 
get a handle on monitoring and optimizing database 
performance? 

Of course, DBAs can turn to a variety of free tools 
that provide basic performance-monitoring functions, 
but the growing complexity of database environments 
often demands a more robust performance-monitoring 
solution. A host of factors can affect SQL Server perfor- 
mance: Are your problems caused by defective hardware, 
stressed CPU resources, or limited system memory? Or 
could database fragmentation, poorly written software, 
or viruses be sapping performance? 


Do Your Homework 

This Buyer's Guide contains a comprehensive list of most 
of the SQL Server performance monitors on the market 
and attempts to provide as much information about each 
tool to help you make the right purchasing decision. Some 
of these products can be expensive, so be sure to perform 
some basic research to find out what solution would be 
right for you. 

According to Chris Shaw, a senior database engineer 
with SQL on Call (www.sqloncall.com), doing a little 
homework before you make that purchase can save you 
lots of time and money. Every SQL Server performance- 
monitoring tool should be able to provide at least as much 
information as the aforementioned free SOL Server moni- 
toring utilities. “Every monitoring tool should be able to 
provide—in one location—all the features that you would 
get from running SQL Server Profiler and Performance 
Monitor." In addition, Shaw suggests that DBAs look for 
the following features when shopping for a performance 
monitor: 

* Low overhead—A good performance monitor must 
be able to run unobtrusively in the background, moni- 
toring performance while consuming as few system 
resources as possible. Some products are well behaved 
in this respect, but others can negatively affect the per- 
formance of the systems they're designed to monitor. 
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* Customizability—SQL Server installations can vary 
widely, so it's important that a performance monitor 
be easily customized to fit the specific needs of your 
environment. Even the most feature-packed program is 
useless if it can't adapt to meet your site requirements. 
History functions—Having the ability to set a perfor- 
mance baseline for comparison purposes is a must. 

“If I were to tell you that your SQL Server CPU uti- 
lization is at 30 percent, that may not mean a whole 
lot,” said Shaw. “You have to be able to compare the 
figure to a historical baseline for the information to be 
meaningful." The best monitors include some form of 
dashboard or reporting function that makes it easy to 
compare current and historical performance. 

Memory counters—Server performance problems can 
take many forms, but Shaw believes that memory- 
related problems are often overlooked. “Look for a 
monitor that includes a memory counter,” he said. “Of 
all the measurable items we can monitor, memory is 
one of the hardest to get a handle on.” 
Scalability—"The tool must be able to scale for an 
enterprise,” explained Shaw. “The ability to perform 
comparisons between different servers based on dif- 
ferent criteria is important. For example, if I have a 
new database coming online and I want to piggyback 
that database onto another server, I need to know what 
the impact is going to be.” 


Planning for the Future 

Some performance monitors are more fully featured than 
others and include advanced features that might be useful 
as your database infrastructure continues to grow. These 
include the ability to set custom alerts and notifications, 
provide performance forecasting and capacity planning, 
and automatically resolve common problems. 

The upcoming release of SQL Server 2008 is another 
important factor to consider. Will you be moving to SQL 
Server 2008 in the near-term, or is an upgrade decision 
still years in the making? Performance Monitor can help 
you squeeze additional performance out of your existing 
infrastructure, thus delaying your upgrade to the new 
platform. SQL Server 2008 will include updated tools for 
performance monitoring, so you also need to carefully 
evaluate the effectiveness of those forthcoming features. 

InstantDoc ID 97581 
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SQL SERVER PERFORMANCE MONITORS 


Company Product i SQL Server Establish: Monitoring: Monitoring: Monitoring: 


Versions Baseline Data? Realtime? Lights-Out? Agent- 
Supported Based? 


BMC Software BMC Performance $975 per CPU 2005, 2000 
713-918-8800 Manager for Databases 
.www.bmc.com. 

CA CA Insight Database Sold by server, unlimited | 2005, 2000 Yes Yes Yes Yes 
800-225-5224 Performance Monitor for | databases by server 

WWW.Ca.com Distributed Databases 

Embarcadero Embarcadero $2,495 per monitored 2005, 2000, 7.0 Yes Yes Yes No 
415-834-3131 Performance Center 2.0 | server 
.www.embarcadero.com. 

Starts at $99 per server | 2005, 2000 Yes Yes Yes Yes 

www.heroix.com 
HP HP SiteScope 2005, 2000 Yes Yes Yes Yes 
800-888-9909 
www.hp.com. 

HybridX SQL Spy 5.2 Free 2005, 2000 Yes Yes Yes Yes 
rvallee@hybridx.com 

www.hybridx.com 

Idera SQL Diagnostic $1,295 per SQL Server 2005, 2000 Yes Yes Yes No 
713-523-4433 Manager 5.0 instance 

sqlSentry SQL Sentry Event $995 per SQL Server 2005, 2000 Yes Yes No 
704-895-6241 Manager for SQL Server, | instance 

www.sqlsentry.com Enterprise Manager 

NetIQ AppManager for SQL $1,200 per monitored 2005, 2000, 7.0 Yes Yes Yes Yes 
713-548-1700 Server server 

www.netiq.com 

Quest Software Performance Analysis From $2,165 per 2005, 2000 Yes Yes Yes Yes 
949-754-8000 for SQL Server monitored server 

www.quest.com 

Spotlight on SQL Server | $2,160 per monitored 2005, 2000 Yes Yes No 

Enterprise server 

Foglight Cartridge for $2,000 per monitored 2005, 2000, 7.0 

SQL Server server 


Solar Winds ipMonitor 8.5 $1,495 for 500 monitors | 2005, 2000 
866-530-8100 

www.ipmonitor.com 

SQL Power Tools Zero Impact SQL $1,200/server 2005, 2000, 7.0, Yes Yes Yes 
307-433-8039 Monitor 6.5 

www.sglpower.com 

Symantec Symantec i3 for SQL $2,100 per CPU socket 2005, 2000 Yes Yes Yes Yes 
408-517-8000 Server 

www.symantec.com 

TeamQuest TeamQuest IT Service TBD 2005, 2000, 7.0, Yes Yes Yes Yes 
641-357-2700 Analyzer 2 6.5 

www.teamquest.com 


EDITOR’S NOTE: Some vendors that you might expect to see in this Buyer’s Guide said they didn’t have a product that exactly matched 


Yes Yes Yes Yes 


Heroix Heroix Longitude 5 
617-527-1550 


Yes Yes 


Yes Yes No 
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SQL SERVER PERFORMANCE MONITORS 


Remote Notification Methods 


Management? 


Automated 
Problem 
Resolution? 


Monitoring: 
Agentless? 


Capacity-Based 
Planning? 


T-SQL Analysis 
and Tuning? 


Report Output Options 


Yes Yes Yes Yes Email, pager, SNMP, system 


broadcast 


HTML, Excel, Text 


Email, pager, SNMP, system 
broadcast 


HTML, Text, Excel. Excel 
output available with a 
CA insight 

Email, pager, SNMP, system HTML, Excel, Text 
broadcast 


Email, pager, SNMP Excel, HTML, PDF 


Email, pager, SNMP Excel, HTML, PDF 


HTML, Text, Excel 


Yes, analysis Console alert, email, pager, CSV, Excel, HTML, PDF, XML 


SNMP, text 


Email, pager, system 
broadcast 


HTML, Excel, Text, PDF 


Email, pager, SNMP, system 
broadcast 


HTML, Excel, Text, PDF 


HTML, PDF 
Email, script, program Uses Microsoft reporting 
services 


Email, log file, pager, script, | Excel, HTML, PDF 
SNMP 


Dedicated link 


Yes 
es 


Y 


Yes 


en je 


the criteria or didn't respond to our requests for information about their products. 
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Email, pager, SNMP, system 
broadcast 


Email, system broadcast 


Email, SNMP, pager, system 
broadcast 


Email, pager, SNMP, system 
broadcast 


HTML, Excel, Text 


Excel, HTML, PDF, Text 


Excel, HTML, PDF, Text 


Excel, HTML, TeamQuest 
GUI 
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WHEN ABOUT THE SESSIONS 
January 28, 2008 - (1:00 AM EST 
Planning for Archiving & Compliance 


WHERE Managed folders and journaling may not be enough as your 

On your computer organization grows. Learn how to combine Exchange’s built-in 
COST features with tiered storage to delay, or possibly even eliminate, 
$99/registrant for |, 2 or all 3 live online sessions the need for a third-party archiving solution. 


(includes access to all archived versions) 

Optimizing Your iSCSI Network Storage 
SESSIONS + i With Exchange 2007 storage, you need to answer some key up-front 
Planning for Archiving & Compliance questions: Will you use fewer servers, or the same? Larger disks, or 


Optimizing Your iSCSI Network Storage more small ones? We'll examine LUN layouts to learn how to optimize 
Memory vs. Spindles - Finding the Sweet Spot iSCSI for Exchange 2007. 


RESERVE A SEAT hy going to: Memory vs. Spindles — Finding the Sweet Spot 
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where’s the sweet spot? When do you stop adding memory and let 


{isk Spindles handle the remaining load? I'll show you how to turn 


SPEAKER Microsoft's guidelines into real-world server configurations. 
Mark Arnold 
MCSE+M, Microsoft MVP REGISTER TODAY — seats are limited, 
T% Mark Arnold is a senior technical to allow lots of live Q&A at the end. (Questions can also be submitted after the 


architect for Anix, a UK-based storage session, by email.) 
integrator, where he solves storage and 
compliance problems for his clients 


by using Microsoft Exchange as a key For more information, or to register, go to: 
www.windowsitpro.com/go/elearning/masteringexchange2007 


component in SAN and NAS deploy- 
ments. He's also a regular contributor to Microsoft's 


"Industry Insiders" TechNet program and is active on ° 6 
Exchange newsgroups and forums. In OWS 0 
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Evaluating the IT 
Certification Market 

hen it comes to choosing a vendor engagement 

strategy for IT pro certification testing, most orga- 
nizations have to decide at some point whether they're going 
to use a sole-sourcing or a dual-sourcing model. Going with 
a single vendor might be more efficient, whereas working 
with multiple vendors encourages competition and provides 
many testing locations, making it easier for employees 
to find training close to where they work. Prometric—a 
company that specializes in technology-enabled testing 
and assessment services—argues in favor of using a single 
vendor for IT pro certification testing. 

I recently spoke with Ray Kelly, senior vice president 
of client services for Prometric, about sole-sourcing versus 
dual-sourcing in the IT pro certification market. Kelly said 
that many organizations went from sole- to dual-sourcing 
because they believed that having a variety of test sites 
would make it easier for their IT pros to get certification. 
Kelly explains that most of these organizations didn't 
see an increase in the number of employees getting IT 
certifications, so the companies returned to sole-sourcing. 
According to Kelly, "There's no reason why an organization 
would dual-source its [IT certification testing] today." 

Prometric (which was acquired by the Educational 
Testing Service in October) was recently chosen to be 
Microsoft's exclusive testing partner for the “total global 
delivery of its professional certification exams." Kelly said 
that Microsoft chose Prometric for four reasons: Prometric 
is the leader in providing scalable testing solutions, has a 
stable underlying business, has the largest testing center 
network (more than 3,000 testing centers worldwide), and 
provides an enhanced user experience. 

So you might be wondering: Why is IT pro certification 
testing so important? In Kelly's view, employers histori- 
cally didn't see certification as a reason to hire someone. 
But organizations have recently begun to realize that cer- 
tification testing is important because it helps employers 
get an independent evaluation of prospective employees’ 
knowledge, skills, and abilities According to Kelly, the 
IT industry is experiencing a skill shortage, and IT pros 
arent staying in the same job as long as they used to. 
Technology is rapidly advancing, and having a relevant 
degree sometimes is no longer enough for a candidate to 
be considered for a position. All these factors contribute 
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to the accelerating pace of change in the IT industry; 
therefore, it's important for employers to know before 
offering a position that a prospective employee has the 
skills necessary to do his or her job. SQL] 


— Megan Bearly 
InstantDoc ID 97398 


Permissions Management 
Gains Urgency 
66 E ntitlement management” is maybe a slightly 
fancier term for what admins in a Microsoft 
environment might call permissions management—that 
is, controlling who gets access to what resources. Win- 
dows admins are accustomed to controlling access to 
applications and data by using Group Policy. You could, 
perhaps, think of Securent’s Entitlement Management 
Solution (EMS) as Group Policy on steroids—it lets you 
set, control, and audit fine-grained access policies for both 
Microsoft and non-Microsoft applications and databases 
from one console and is designed so that business users 
can set policies for the content they manage. 

In a recent phone briefing, Sekhar Sarukkai, Securent 
CTO and cofounder, described scenarios in which entitle- 
ment management can be key to enterprises and to some 
smaller businesses. A medical group might want to let 
patients determine which information on their medical 
records a consulting doctor can access and which data 
points family members can see. A financial services com- 
pany might want to enforce an enterprisewide policy that 
prohibits analysts from publishing insider information on 
internal SharePoint sites until the data is public. 

Sarukkai mentioned that using virtual machine (VM) 
technology for purposes such as server consolidation is 
a big trend at enterprises. Entitlement management can 
help companies enforce policies that specify who can set 
up VMs and what applications and data a virtual desktop 
can access. 

Another big driver for a centrally managed entitle- 
ment management solution is the reporting and auditing 
requirements of state and federal agencies, according to 
Sarukkai. Auditing one set of policies managed from one 
console could be easier than auditing multiple sets from 
various applications and databases. [SOLI 

—Renee Munshi 
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NEW PRODUCTS 


Q Editors Tip 


Got a great new product? 
Send announcements to 


products @ sqlmag.com 


—Jeff James, senior editor 
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Head First 


TRAINING 


Learn the SQL Language 

Head First SQL from O'Reilly Media is aimed at giving readers an introduction to the 
SQL language. Written by Lynn Beighley, Head First SQL explains how to organize 
information in tables, covers basic INSERT statements and SELECT queries, and 
delves into more intensive data management topics such as joins and transactions. 
O'Reilly Media claims that the Head First series relies on the "latest research in 
neurobiology, cognitive science, and learning theory” to offer a book filled with pictures, comics, real-world examples, 
puzzles, and other content to keep readers interested and engaged in the subject matter. Head First SQL is now available 
and retails for $44.99. For more information, contact O'Reilly Media at 707-827-7000 or visit www.oreilly.com. 


DATABASE AUTOMATION 


Simplify Database Operations 

GridApp Systems has announced Clarity 4.0, the latest version of its database automation product. GridApp Systems 
claims that the automation features in the new release eliminate the need for DBAs to create and manage provisioning 
scripts. Clarity 4.0's improved database management capabilities include centralized update delivery, advanced database 
recovery, and the ability to scale to support thousands of databases. Clarity 4.0 also includes more robust support for 
heterogeneous environments and provides a database server validation option based on industry best practices. For more 
information about Clarity 4.0, contact GridApp Systems at 646-452-4100 or visit www.gridapp.com. 


DATABASE DEPLOYMENT 


Streamline Application Delivery 

Automate database deployment with xSQL Builder, a new product from xSQL Software. Using xSQL Builder's deploy- 
ment feature, DBAs can create standalone executable packages of their database applications. 
These packages can be incorporated into a traditional setup and deployment process or deployed 
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custom scripts that help facilitate database application deployment. Pricing for xSQL Builder 
starts at $499 per user. For more information, contact xSQL Software at 770-939-7117 or visit 


www.xsqlsoftware.com. 
BUSINESS INTELLIGENCE 


Share and Publish Data Discovery and Analysis Information 

Tableau Software’s new product, Tableau Server, makes it easy to analyze and discover corporate 
data. Users can create multiple views of data from various sources and then publish that informa- 
tion to Tableau Server. Other users can then view, sort, search, and comment on that information 
through a Web interface. If the underlying data changes, the information updates in real time. 
Users who publish information via Tableau Server can restrict access to that information to only 
approved users, and DBAs have additional controls that limit how the available information is shared and distributed. 
For more information, contact Tableau Software at 206-633-3400 or visit www.tableausoftware.com. 


DATABASE SECURITY 


Encrypt and Protect Database Objects 

Keeping your data secure is the goal of SQL CodeSecure 1.2.0, a database security product from SqlLabs. The software 
includes a full-featured auditing tool that keeps tabs on any changes made to a monitored database. SQL CodeSecure 
tracks access to data by IP address, and can also generate information about which users’ logins are responsible for 
changes, and when and how those changes were made. Valuable code and object definitions can be encrypted for extra 
security, while a rollback feature lets DBAs undo changes made to a database and return the environment to a secure 
state. Pricing for a single license starts at $175. For more information, contact SqlLabs at info@sql-labs.com or visit 


www.sgl-labs.com. [SQL| 
InstantDoc ID 97560 
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Learn Microsoft? SQL Server" 2005 
and Business Intelligence (Bl) 


Introducing the latest in SOL Server 2005 and Business Intelligence (BI) courses from AppDev, the nation's leader in developer 
learning. Our nationally recognized industry experts will walk you step-by-step through the features and functionalities of these 
exciting SQL Server 2005 technologies! 


Microsoft SQL Server 2005 20 CD-ROMs or 2 DVD-ROMs 


Microsoft SQL Server 2005 Reporting Services (SSRS) 8 CD-ROMs or 1 DVD-ROM 
Microsoft SQL Server 2005 Analysis Services (SSAS) 8 CD-ROMs or | DVD-ROM 


Microsoft SQL Server 2005 Integration Services (SSIS) 8 CD-ROMs or 1 DVD-ROM 


BUY 1, GET 1 


For a limited time, purchase one of our SQL Server 2005 courses above, get another SOL Server 2005 course 
(of equal or lesser value) FREE! Or get all four SOL Server 2005 courses in one money-saving learning suite! 


Visit our Web site today for offer details, plus course outlines and 
AppDev Expert Andy Baron more information about our new SQL Server 2005 courses. 
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WHATEVER YOU'RE 
DOING THERE LOOKS 
LIKE A COMPLETE 
WASTE OF TIME. 


S Server Management Studio (SSMS) is the 
Q most frequently used tool in the SQL Server 
2005 management suite. Even if you use it daily, however, 
you might not realize the tasks you can do with it. 


Create Shared Server Registrations 

Do you get tired of having to re-register your servers when 
you move to a different SSMS workstation? You can save 
and restore your server registrations. Open the Registered 
Servers window using View, Registered Servers; right-click 
a node, then select Export. To import the registration 
information file to another SSMS system, on that system 
open the Registered Servers window, then right-click a 
node and select Import. 


Manage Integration Services 

By default, SSMS's Connect to Server opens to the Data- 
base server. However, by selecting Integration Services you 
can manage running packages and view stored packages. 
You can also use the SSMS Connect To dialog box to 
connect to Analysis Services, Reporting Services, and even 
SQL Server Compact Edition. 


Change the SSMS Startup Window 

If you often use Query Editor, you can save some work by 
changing the SSMS startup options. Go to Tools, Options, 
Environment, then use the drop-down menu to change 
the At startup setting. I prefer Open Object Explorer and 
new query. 


Get Quick System Summary Info Using 

the Server Dashboard 

The Server Dashboard, new in SQL Server 2005, shows an 
overview of your current server status including CPU utili- 
zation, total server memory used, active sessions, blocked 
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transactions, and more. You can view the Server Dash- 
board by opening Object Explorer, then right-clicking 
a server node. From the context menu, select Reports, 
Standard Reports, Server Dashboard. 


Jumpstart Your T-SQL Scripts Using Templates 
SSMS includes templates for a wide array of T-SQL 
tasks, from creating triggers and stored procedures 
to configuring Database Mail. Select View, Template 
Explorer and expand the template node you want to use, 
then double-click the template to pull it up in SSMS's 
Query Editor. 


Highlight FSQL Errors 

Although it doesn't debug T-SQL, Query Editor can find 
the lines causing T-SQL errors. Go to the Messages pane 
and double-click the error, displayed in red. The error line 
will be highlighted in the Editing pane. 


Display Line Numbers in Query Editor 

Query Editor's Messages pane by default doesn't display the 
line numbers of T-SQL syntax errors. To show line numbers 
in Query Editor, go to Tools, Options then expand All Lan- 
guages and select the Line numbers check box. 


Automatically Generate Scripts 
The Script button in the top left corner of almost all 
SSMS dialog boxes makes it easy to create and save 
T-SQL scripts. To use it, just fill out your SSMS dialog 
box, then instead of clicking OK (which would normally 
execute the action), click the Script button. The T-SQL 
code to perform the action will be written to a new Query 
Editor window. This scripting option is also a great tool 
for novices looking to learn more about T-SQL. E 
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= Download a FREE 14-day 
SQL diagnostic manager product trial: 
www.idera.com/TheUltimate 


Let Idera's 
SQL diagnostic manager make you 


a Real Life 
SOL Server Superhero 


o 
us MONITOR, DIAGNOSE AND ANALYZE SQL SERVER 
| (cf e) PERFORMANCE WITH SOL DIAGNOSTIC MANAGER V5.0 
TOOLS FOR SQL SERVER" 
SQL diagnostic manager is a * Monitor and manage SOL Servers 
powerful performance enterprise-wide 
Award-winning monitoring and diagnostics e Find and fix performance 
solution that proactively alerts bottlenecks 
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